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Feature: 


F1 : Entry Door Width-applies only to HC accessible toilet rooms. 


Possible Values: 


A,l, U 


Multiplier: 


2 


Rule: 


A: All entry doors are 32 to 40 inches wide. 

I: One or more entry doors are 30 or 42 inches wide. 

U: Anything else. 


Method: 




Comment: 


Individual toilet rooms may have more than one entry door. They 
must all satisfy this requirement 


Question: 





FIG. 12 
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Feature: 


F1a: Entry Door Width: Non-accessible Toilet Rooms. 


Possible Values: 


A, I, U 


Multiplier 


2 


Rule: 


A: All entry doors to Non-HC toilet rooms are 24" or greater. 
I: One or more 22" wide. 
U: Anything else. 


Method: 




Comment: 


Individual toilet rooms may have more than one entry door. They 
must all satisfy this requirement. 


Question: 





FIG. 13 
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Feature: 

Possible Values: 

Multiplier: 

Rule: 



Method: 



F2: Latch Clearance 

A, I, U 

1 

In toilet rooms that are author-specified HC accessible, all doors 
meet the following requirements: 

A: Conforms to code from both the push and pult side of the door 
I: One or more 2" off. 
U: Anything else. 

On the latch side of a door, a wall or other obstruction may not be 
within 18" on the pull side and 12D on the push side. 



Comment: 



Question: 





18 




12 
** 
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Feature: 

Possible Values: 

Multiplier: 

Rule: 



Method: 



Comment: 
Question: 



F3: Virtual Clearance 

A, I, U 

1 

In toilet rooms that are author-specified HC accessible* all doors 
meet the following requirements: 

A: Conforms to code from both the push and pull side of the door. 
(60 pull side, 48 push side). 

I: One or more 2" off (58 pull side or 46 pull side). 

U: Anything else. 

On the latch side of a door, a perpendicular wall or other 
obstruction may not be within 60" on the pull side and 48" on the 
push side. 



60 



48 
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Feature: 


F3a: Two Doors in Series (New Feature) Same as for C5 (Ramp). 
For accessible toilet rooms only. 


Possible Values: 


A, 1, U 


Multiplier: 


1 


Rule: 


A: 
1: 

U: Anything else. 


Method: 




Comment: 




Question: 
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Feature: 

Possible Values: 

Multiplier: 

Rule: 



Method: 



Comment: 
Question: 



F4: Encroachment, HC Water Closet 

A. I, U 

2 

All HC Water Closets must have: 

A: A minimum 5' x 2 -6 non-encroachment zone, with the water 
closet centerline at least 18" from side walls. The door swing 
may not enter the non-encroachment zone. 

I: One or more length and/or width of zone is 2" too small, or HC 
water closet is only 16-18* from side wail. 

U: Anything else. 



2 f -6 



FIG. 17 
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Feature: 
Possible Values: 
Multiplier 
Rule: 



Method: 



F5: Encroachment, HC Lavatory 

A, I, U 

2 

All HC lavatories must have: 

A: A minimum 30 x 46* non-encroachment zone. 

I: One or more length and/or width of zone is 2" too small. 

U: Anything else. 

No object may encroach on the zone as shown below. The door 
swing may encroach! 



Comment 
Question: 



30 



48 



FIG. 18 
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Feature: 
Possible Values: 
Multiplier 
Rule: 



Method: 



Comment: 
Question: 



F6: Encroachment, HC Urinal 

A, I, U 

2 

All HC urinals must have: 
A: A minimum 30 x 48* zone. 

I: One or more witn length and/or width of zone Is 2" too small. 
U: Anything else. 

No object may encroach on the zone as shown below. The door 
swing may encroach! 



30 



48 
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Feature: F7: Encroachment HC Amenity 

Possible Values: A, I, U 
Multiplier 2 

Rule: HG amenity (either a shower or an infant changing table) must 

have: 

Infant Changing Table 

A: A minimum 3" x 4" zone 

I: Length and/or width of zone is 2" too small 

U: Anything else. 

Roll-in Shower Stall 

A: A 3* x 5' encroachment zone that abuts the shower door. 
I: Length and/or width of zone is 2" too small. 
U: Anything else. 

Method: 

Shower: No object may encroach on the zone as shown below. Door swings may 
encroach. 



36" 



Changing Table: No object may encroach on the zone as shown below. Door swings 
may encroach. 



36" 



FIG. 20 



04/28/2004, EAST Version: 1.4.1 



U.S. Patent 



May 2, 2000 



Sheet 21 of 70 



6,056,556 



Feature: 

Possible Values: 

Multiplier: 

Rule: 

Method: 

Comment: 
Question: 



F8: Side Grab Bar Location 

A, I. U 

1 

A: Side grab bars are drawn for HC water closets and are located 
on the side wall of the stall within 12" of the waH behind the 
WC. 

I: One or more within 14*. 
U: Anything else. 
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Feature: 

Possible Values: 

Multiplier. 

Rule: 



Method: 



Comment: 
Question: 



F9: Rear Grab Bar Location 

A, I. U 

1 

A: All rear grab bars are drawn for all HC water closets and are 
located on the wall behind the WC and up to 6" from the 
nearest side wall. 

I: One or more within 8". 

U: Anything else. 
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Feature: 

Possible Values: 

Multiplier: 

Rule: 



Method: 



Comment: 
Question: 



F10: Encroachment, Non-Accessible Water Closet Stall 

A, I, U 

2 

All Non-HC water closets must have: 
A: A minimum of 30" wide and 54" deep. A: 
I: One or more stalls 2" too narrow and/or too shallow. 
U: Anything else. 
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Multiplier 
Rule: 



Method: 



Comment: 
Question: 



F11; Encroachment Lavatory 

A, I, U 

2 

All Non-HC lavatories must have: 

A: A minimum 30 x 30" norvencroachment zone. 

I: One or more length and/or width of zone is 2" too smalt. 

U: Anything else. 

No object may encroach on the zone as shown below. Door swings 
may encroach. 
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Feature: 


F12: Encroachment, Urinal 


Possible Values: 


A, I, U 






Multiplier: 


2 






Rule: 


All Non-HC urinals must have: 

A: A minimum 30 x 30" non-encroachment zone. 

1: One or more length andVor width of zone is 2' too small. 

U: Anything else. 


Method: 


No object may encroach on the zone as shown below. Door swings 
may encroach. 

L J 












4 ► 

30 




30 


Comment: 








Question: 









FIG. 25 
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Feature: 
Possible Values: 
Multiplier 
Rule: 



Method: 

Comment: 

Question: 



F13: Travel Path Width 

A, I, U 

1 

A: Travel paths from every entry door of a toilet room must 
maintain a minimum width of 36* to each fixture in that toilet 
room. 

I: A minimum width of 30* is maintained. 
U: Anything else. 
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Feature: 

Possible Values: 

Multiplier 

Rule: 



Method: 

Comment: 

Question: 



F14: Turning Radius 

A, I, U 

1 

In toilet rooms that are author-specified HC accessible: 

A: A turning circle of a minimum of 60* in diameter must exist 
somewhere within the toilet room, and must be connected to 
the travel path. 

I: 58". 

U: Anything else. 
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Feature: 

Possible Values: 

Multiplier 

Rule: 



Method; 



F15: View 
A. !,U 
1 

A: For aHfOoms, the view cone includes no staB doors or urinals 

I; For one or more rooms the view com includes one or more 
stall doors but no urinals. 

U: For one or more rooms the vfew cone includes one or more 
urinals. 

The view cone is everything that can be seen Walking past the 
door. An outsWlhgthg door in the open position (shown betew) may 
itself screen the view somewhat 



Comment: 
QuesiSon: 




, ... This area h within the 

/ cone of vision 



FIG. 28 



04/28/2004, EAST Version: 1.4.1 



U.S. Patent May 2, 2000 Sheet 29 of 70 6,056,556 



Feature: 


F16: Wall Thickness 


Possible Values: 


A, U 


Multiplier: 


1 


Rule: 


A: All water closets, and urinals should abut 8" walls for their full 
width. 

U: One or more do not. 


Method: 




Comment: 


The candidate can •thicken' the existing 4" walls by using the wall 
tool to increase the thickness to 8* (or more). 


Question: 





FIG. 29 
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Feature: 


F17: Fixtures / Wall Relationship 


Possible Values: 


A, I, U 


Multiplier 


1 


Rule: 


A: All fixtures are located on or within T of the wall. 

I: One or more fixtures are 4" from the wall or 2" into the wall. 

U: Anything else. 


Method: 




Comment: 




Question: 
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Feature: 


F18: Room Placement 


Possible Values: 


A t F 


Multiplier: 


fatal 


Rule. 


A: All toilet rooms are configured within footprint. 
F: Anything else. 


Method: 




Comment: 




Question: 
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Feature: 


F19: Toilet Room Designed 


Possible Values: 


A, F 


Multiplier 


fatal 


Rule: 


A: All prescribed toilet rooms are designed. 
F: Anything else. 


Method: 


A toilet room is considered designed if it is enclosed, it is 
accessible from public space, and it is labeled with a single label. 


Comment: 




Question: 
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Feature: 


F20: Water Closet Stalls Drawn 




Possible Values: 


A.F 




Multiplier: 


fatal 




Rule: 


A: All water closets are enclosed in stalls 
or wider. 

F: Anything else. 


; with one door 24* wide 


Method: 






Comment 






Question: 
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Feature: 


F21: Room Configuration 


Possible Values: 


A, F 


Multiplier: 


fatal 


Rule: 


A: Each toilet room must have the prescribed fixtures (HC and 
non-HC water closets, urinals and lavatories, and shower or 
infant changing table). 

F: Anything else. 


Method: 




Comment: 




Question: 
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M1: Master 

Composed of: Matrices/features Multiplier Possible Values 

M2 Entry Door 1 AIU 

M3 Handicapped Features 2 AIU 

M5 Other Fixtures 1 Al U 

M6 Travel Path 2 AIU 

M7 Design Logic 1 AIU 
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M2: Entry Door 

Composed of: Matrices/features Multiplier Possible Values 

F1 Width 2 AIU 

F2 Latch Clearance 1 AIU 

F3 Virtual Clearance 1 AIU 
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M3: Handicapped Fixtures 

Composed of: Matrices/features Multiplier Possible Values 



F4 Encroachment - WC 2 AIU 

F5 Encroachement - Lavatory 2 AIU 

F6 Encroachment - Urinal 2 AIU 

F7 Encroachment - Amenity 2 AIU 

M4 Grab Bar 1 AIU 
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M4: Grab Bar 

Composed of: Matrices/features Multiplier Possible Values 



F8 Side Grab Bar 1 AIU 

F9 Rear Grab Bar 1 AIU 

U's 



I's 



MM 


0 


h 


2 


3 


4 


5 


6 


7 


I 8 


9 


10 


0 


A 


i 


U 


















1 


I 


u 




















2 


U 






















3 
























4 
























5 
























6 
























7 
























8 
























9 
























10 
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M5: Other Fixtures 

Composed of: Matrices/features Multiplier Possible Values 

F10 Encroachment - WC 1 AIU 

F1 1 Encroachment - Lavatory 1 AIU 

F12 Encroachment - Urinal 1 AIU 
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M5| 0 


1 


2 


3 


4 


5 


.17 


8 


9 


10 


0 


A 


I 


U 




















A 


U 




















2 


1 


u 




















3 


U 






















4 
























5 
























6 
























7 
























8 
























9 
























10 
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M6: Travel Path 

Composed of: Matrices/features Multiplier Possible Values 



F13 Width 1 AU 

F14 Turning Radius 1 AIL) 

U's 
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M7: Design Logic 

Composed of: Matrices/features Multiplier Possible Values 

F15View 1 AIU 

F16 Wall Thickness 1 AU 

F17 Fixtures / Wall Relationship 1 AIU 
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The 4" wall is drawn in the following way: 



The endpoint of that line is fixed by click 
#2. When the cursor is moved perpendicularly 
to the line (above or below) , 3 dotted lines 
show the candidate the wall that will be 
formed. The wall should be the length of the 
rubberbanding line, and 4" in width, 
regardless of how far the cursor is Click #1 
starts a rubberbanding line. moved from the 
line. Click #3 completes the wall. Allow an 
unlimited number to be drawn. 




± 



i j 



3 
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FIG. 43 
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FIG. 44 
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FIG. 45 
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Site Section Vignette 

|AI! of ihe information you wit need to devetop your solution can be accessed through this Index screen. 

j&ick on one of the following to select 

Vignette Directions 
I Program 

tTo access this screen while you are working, stmpV press the space bar When this screen appears, dick on the 
jtopic you wish to view. 

i 

[To return to the Inctex from one of the topics, click on the Inctex button that appears at the top ol ttie saeen . 

jib go to the work saeen, press the space bar, 

\ 

Review the General Test Directions 



i 
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To return to the Vignette Index. ci'dftinth© Index button at the top of m screen. Togotothev^ 

.spacebar; 

JppB^ throu^t a pa^cy ar;«te. Yew arist asted to r^radethe sSta and to ptat© 
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you are asked to locate a nature study facility, en observation tow*er. and a stone terrace on a gontt/ sloping 
mountainside. 

1. Place the nature sludyfecility so that it is at least 50 ft from tfie tree line. 

• Both levels of the r^re study facility shal be accessibfe to grade. 

• The nature study facility shall not be located on fin. i 

• There shal be positive coinage from both sides of the naatfestu<fy facility for a minimum dist®K9 of 5 ft. \ 

2. Place the observation tower so thatthe deck level is near elevation 90 ft and no part of the tower extends 
above elevation 100 ft. 

3. Race the stone terrace so that ftis no more than 15 ft horizontally orverticatlyfrom die lower level of the nature i 
studyfaciMy. 

• Place the stone terrace so that it is protected from the winter winds, 

H, Draw a new grade fine so that the minimum slope at a cut or fil condition is 5:1 (5 units horizontal to 1 vertical) J 
and the maximum slope at a cut or f$ condition is 2:1. 

!$. Observe the following additional restrictions. 

• No recanang walls are permitted/ 

• Any change made to the existing grade shall not increase the volume of water draining onto adjacent 
property. | 

• Ail items placed on the site shaS be id Ey supported by existing or new grade. 

• No excavation into bedrock is permitted. 

• The existing grade cannot be modified within the drip Sne of a tree. | 
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fro return to the Vignette index click em the index button at the top of the screen. To go to me work screen, press me i 
jspacebar. 

j . Tips 

I Procedural tips for Site Section 
* In this vSgnette you are asked to place elements in section. Where the elements are placed should 

! determine the regrading of the site. 
• f the outline of an object blocks the grade Bne, assume th& the grade line rims eiongthe base of the object. ^ 
• When elements overlap, you may have trouble selecting a perjflcuiar element. & this happens, keep di cki ng i; 
(without moving the mouse) urtti* the desired: element h^hSghts. 
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fTo return to the Vignette Index, click on the lids* button at the top of the screen. To go to the workscreen, press 
|he space bar 

General Test Directions 



Ijn.order to ensure precision and accuracy of measurement, each vignette type is intended to assess a limited set :|j 
]of design skills, knowledges, and abilities, As vousotve the problems posed by the vignettes, therefore, you wi8 f| 
|>e asked to focus on specific design issues rather thai to confront 6li of the design issues that a particular 
broblem might represent. 

Iyou: should read the directions given for each vignette carefully in order to familiarize yourself with the scope of 
fevignette arid the nature of the problem that it presents, in order to give yourself the best opportunity to 
[demonstrate your ability, you should plan your work on a vignette so that It can be completed within the time ? jj 
javaiiabie, : >,'.j 

;ln ejdeStion to the vignette directions, other t8sk informedoftis provided, such as program and code requirements, ^ I 
Ithat is needed for soMng the problem posed by the vigiette. The requirements established by these materials 
lare to be observed since tfiey wiH be used in scoring the vignette. You shouid not consider outsi de information pi;; 
^.conflicts with the requirements presented in the vtgrwtte, such as knowledge of code requirements in a 
particular jurisdiction. The problems presented by the vignettes are intended to be straightforward aid solvable xJ 
[using the informaison provided- You stoutd not assume that any unstated unusual conditions exist. -A 

^Differences in prefeired worn styles and degrees of comfort with using a computer as a design tool may dictate ^ 
jdfferent strategies for different candidates m working o& and recorcBng solutions to vignettes. Some may wish ■ % 
jto work out and refine solutions on the screen usi ng the tools provided, white others may wish to devetop 
(solutions on scratch paper and then use the tools to reproduce the so&itions on ihe screen for recording and =>s 
[scoring. 
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i order to ensure precision and accuracy of measurement, each vignette type is intended to assess a Bmited set i[ 
>f desi^i $kjlls> knowle<fees< and abilities, A$ you solve the problems posed by the vignettes, therefore, you will f* 
\ asked to focus on specific design issues rather than to confront as of the design issues thai a particular 
IwWem might represent. ^ 

jvou should read the directi oris given for each vignette carefully In order to famiBarize yourself with the scope of 

|he vignette and the nature of the problem that it presents, in order to £ ve yoarseK the best opportunity to \ 

Idemonstrate your ability, you should pian your work on a vi gnette so that it can be correlated wfthin the time ^} 

pliable. |>i 

|n addidon to the vignette directions, other task information is provided, such as program and code requirements, ^ 
lhat is needed for soMng the problem posed by the vignette. The requirements established 1 by these materials ^; 
jare to be observed since they vtiS be used in scoring the vignette. You should not consider outside information i £ 
jthat conflicts with the requirements presented in the vignette, such as knowledge of code requirements in a ^ 
particular jurisdiction., the problems presented by the vignettes are intended to be strai^onwardand solvate ^ 
jusing the information provided. You should not assume that any instated unusual conditions exist \i\ 

bifferences in preferred work styles and degrees of comfort with using a computer as a design tool may dictate 

different strategies for different candidates in working out and recording solutions to vignettes. Some may wish *3j 
jto work out and refine solutions on the screen using the tools provided, while others may wish to develop 

soltaions on scratch paper and then use the tools to reproduce the sokrtions on the screen for record) ng and : -;| 
scoring. " 

I . T% 

iYou may not use reference materials otherthan those provided in the vignette directions, texts, or other 

idocurnents during the examin^ion. You may use the scratch paperthaihas been provided, but you must turn it in >£? 

jatthe end crftheexamtnatfon. YOU ARE NOT TO USE ANY OTHER PAPER. j£j 

jYbur solution to each problem wiD be scored, as appropriate, on the basis of responsiveness to code and y 
jpipgramreq^^ .M 
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To return to «w Vignetted To go to fee work screen, press the 

spacebar. 

I Vignette Directions 

[On the vw1< screen you vw9^ a lo^ Th&tools 
^^levwflaflowyouto^anip^ Yc^cofnptetedwofksTiouW show the siteplanwith 

Icontours that vM successfully aiw *3ter to flowfrom the site in accordance v*th the program and site conditions. ■ 

jBefore be^ngyour solution, you should review the program that can be accessed ttirotigft the Vignette fcidex 
jscreen and familiarize yours*Ef v«th the sit»p^OTti^ work screen. 
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|To f^m to tte Vi^tte lrKJex.cBckonth8 Index button at the top cftfce screen. To go to the work screen, press the 
cebsr. . 

Program 

[A WorfelVVsrl monum^ntwas ^eP9^^s^Qp9=ift■9^; atyparkintteiate 194ffs. It consists of a stone per/ed 
jareewth @i obelise ^ its center, thepa&k 

ft. Re^^thesiteso^^ 
p. The 

'p. The ©(1^ light stands on either side of; the rrkmumert arKl die two groups <rf exislir^ trees shefl rsCt be 
I disturbed. 

% The slope of the ^graded portions of the site sheo not exceed 20%. 



\ 
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[Tore to to the Vignette index, click on the Index button attfce top of tho screen. To go to the work screen, press the 
[space ban 



Tips 

procedural tip* for Site Grading 

• Eraae affects aD<^ges that haw ^ Umfo affects tte last action onty. 

| * YVten elements overiap,^ 

| (without moving the mouse) urii the desired element ^ghSg^tte. 

| 



I 

t 
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Ml 



SteGradfeig 



X 



I 



Prkmy Objoct DntapjB 
F1 MJ 2 



Contour lifcntoulsfan ki Bckaton 



1 



Touching Contain 
F3 AF fatal 



No Contour Manipulation 
F4 AF fatal 
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Feature: 


F1: Primary Object Drainage 


Possible Values: 


A, U 


Multiplier: 




Rule: 


A: The amount of water draining across the primary object is 
decreased by <Min%lmproveForA> (use 75%). 

U: It isn t. 


Method: 


The amount of water that crosses the primary object before the 
candidate's contour alterations must be measured. If the alterations 
result in a Min%lmproveForA> decrease in the amount of water 
entering the primary object from the site, an A is assigned. 


Comment: 




Question: 
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Feature: 

Possible Values: 

Multiplier: 

Rule: 

Method: 

Comment: 
Question: 



F2: Cut or Fill Within Exclusionary Objects or Over Property Line 



A: Contour manipulation has not taken place within exclusionary 
objects, beyond <ExclusionaryObjectBuffer> (use 300mm) or 
beyond the PropertvLine beyond <ExclusionaryObjectBuffer>. 

U: Anything else. 

Manipulation is considered to have happen if contours within 
exclusionary object deviate more than <ExdusionaryObjectBuffer> 
from their initial positions. 
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Feature: 


F3: Touching or Overlapping Contours 


Possible Values: 


Fatal 


Multiplier: 




Rule: 


A: Contours of differing elevations do not touch or overlap. 
F: Anything else. 


Method: 




Comment: 




Question: 
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Feature: 


F4: No Contour Manipulation 


Possible Values: 


Fatal 


Multiplier 




Rule: 


A: The candidate has manipulated (drawn) one or more contours. 
F: Anything else. 


Method: 




Comment: 




Question 
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M1: Site Section 

Composed of: Matrices/features Multiplier Possible Values 

F1 Slope Drainage 1 AU 

F2 Primary Object Drainage 2 AU 

U'S 



M1 
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1 2 
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BATHROOM REMODEL 
M1 





I 


I 


I 


I 


FIXTURES 
M2 AIU 4 




ACCESSORIES 
M3 AIU 1 




CABINETS 
M4 AIU 3 




LIGHTS 
U5 AIU 2 




GENERAL 
M6 AF FATAL 



TOILET 
M7 AIU 1 



REAR CLEARANCE] 
F1 AIU 1 



FUZZY RUG 
F9 AU 1 



SEAT COVER 
F10 AU 1 



SIDE CLEARANCE 
F2 AIU 1 



FRONT CLEARANCE) 
F3 AiU 2 



LAVATORY 
MB AIU 1 



j^EAR CLEARANCE 
F4 AIU 1 



UFRONT CLEARANCE! 
F5 AU 2 



VANITY BELOW 
F6 AU 2 

BATHTUB 
M9 AIU 1 



VANITY 
M10 ARJ 1 



OVER VANITY 
F15 ARJ 1 



ALL FIXTURES PRESENT! 
F17 AF FATAL 



PEAR CLEARANCE] 
Ftl AU 1 



OVER TOILET 
F16 AIU 1 



FRONT CLEARANCE) 
F12 AU 2 



IMN 
M11 AIU 3 



-IREAR CLEARANCE] 
I F13 AIU 1 



FRONT CLEARANCE 
F14 AU 2 
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FRONT CLEARANCE 
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C607a.aut 

Spaces 

Doors 

Tags 

GrabBar 

InfantChangingTable 

Lavatory 

ALavatory 

AShower 

Urinal 

AUrinal 

WaterCloset 

AWaterCloset 
VIEW SOURCE CODE 

View.h 

View.cpp 
SETBACKS SOURCE CODE 
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SCFILTER.CPP 
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FILTAB.CPP 
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CLAIMS 
5 ABSTRACT 

A portion of the disclosure of this patent document 
contains material which is subject to copyright protection. 
The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent disclosure, as it 
10 appears in the Patent and Trademark Office public patent 
files or records, but otherwise reserves all copyright rights 
whatsoever. 
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BACKGROUND OF THE INVENTION 



1. Field of the Invention 

The present invention relates to computer-based technol- 
ogy in assessment particularly for the licensing and certifi- 
cation of professionals such as architects, civil engineers, 
aeronautical engineers, mechanical engineers, naval 
engineers, interior design, landscape design, architectural 
design, etc. For assessment of architects, the system includes 
tools and methods for item creation, computer programs fbr 
computerized item presentation, and programs for automati- 
cally scoring test responses by computer. 

The purpose of assessment in licensing and certification is 
to make accurate and reliable decisions as to whether a 
candidate has met certain standards of competent 
performance, ordinarily involving a range of higher order 
cognitive skills as well as the mastery of an extensive 
knowledge base. 

The National Council of Architectural Registration 
Boards (NCARB) each year prepares the Architecture Reg- 
istration Exam (ARE) to register entry-level candidates for 
the practice of architecture. This registration examination is 
used by 55 member jurisdictions and most Canadian prov- 
inces as the basis for initial licensure and reciprocity. The 
goal of the Architecture Registration Exam is to ensure that 
only architectural candidates proven to meet a competency 
level established to protect the health safety and welfare of 
the public are allowed to practice in the profession. 

In the past, the examination consisted of several multiple- 
choice tests and graphics tests administered annually over a 
four-day period, with the graphics tests administered one 
45 additional time each year. The core functions of architectural 
practice, namely, site design and building design, are 
accorded fundamental importance in the graphics tests. 
Since the purpose of the examination is to protect the 
public's health safety and welfare, the component tests focus 
so on essential elements of competent practice, rather than on 
areas like aesthetics of design. Nonetheless, candidates have 
some opportunity to display creativity by accomplishing 
tasks requiring problem -solving under constraints. 

2. Description of Related Art 

While the ARE was originally entirely a paper-and-pencil 
based test, recently multiple-choice parts of the examination 
have been administered by computer in a format patented by 
Educational Testing Service, inventors' assignee, and called 
Computerized Mastery Testing. That patent, U.S. Pat, No. 
5,059,127, entitled COMPUTERIZED MASTERY TEST- 
ING SYSTEM, A COMPUTER ADMINISTERED VARI- 
ABLE LENGTH SEQUENTIAL TESTING SYSTEM FOR 
MAKING PASS/FAIL DECISIONS, is hereby incorporated 
herein. 

In the paper-and-pencil implementation of the building 
design graphics test, a candidate for registration spends 12 
hours developing plans and drawing related sections and 
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elevations. The output of this paper-and-pencil test is a pad 
of four drawings. Over a hundred architect/jurors meet for 
three days twice a year to grade these drawings using a 
holistic grading process. 

While in the paper-and-pencil implementation of the site 
design graphics test, a candidate spends two and three- 
quarters hours developing solutions to site design vignettes. 
These drawings are also graded holistically in sessions twice 
a year involving nearly seventy additional architect/jurors. 
Figural Response. 

The present invention is different from another testing 
methodology called "figural response** invented and pat- 
ented by applicants* assignee Education Testing Service. 
See, e.g., U.S. Pat. No. 5,011,413, entided MACHINE- 
1NTERPRETABLE FIGURAL RESPONSE TESTING. 

Figural response requires the candidate to respond to a 
graphic question or problem presented on a video display, by 
drawing lines or other simple geometric figures, positioning 
arrows or other markers on the graphic, or repositioning 
elements of the graphic, etc. While figural response may 
appear to be similar to the simulation methodology of the 
present invention, differs in many respects — some of which 
follow. The tasks required of the candidate in figural 
response were necessarily simpler resulting in problems of 
a relatively limited nature with but one correct answer for 
each figural response item. 

Figural response relies on bitmap graphics; the present 
invention relies on a completely different method of image 
representation called vector graphics. Two main benefits of 
a vector based approach to graphics are that all the things 
shown on the screen to the candidate are represented as 
discrete and insular "objects** inside the computer, rather 
than as mere regions of a bitmap. A vector/object approach 
makes building a rich and complex scoring system a much 
less arduous task. Similarly, a vector/object approach makes 
the creation of new objects much easier to do. 

Though both tests are graphical in presentation the nature 
of the tasks required by the test taker are very different. 
Figural response required the test taker to use a mouse to 
select one of several pictures, or to draw a fine connecting 
two related images. Each figural response item has a single 
correct answer. The present invention asks the candidate to 
construct a complete architectural drawing on a nearly blank 
background. Because of the level of detail allowed, and a 
conscious effort on the part of the developers to allow for 
individual style and creativity, there can be an infinite 
number of equally valid solutions to most of the ARE items. 

The figural response items were limited to fixed screen 
sizes whereas the items of the present invention can be used 
at any resolution from 480x600 on up. This is because vector 
images can scale themselves to fit various screen or area 
requirements much more easily than bitmaps can. 

Finally, although figural response items are scored by 
computer the scoring programs are much simpler because 
the tasks required of the candidate were much simpler The 
simplicity of the task also means that there is only one 
correct answer to a figural response question, as noted 
above. Despite that simplicity, there was very little reuse of 
code across figural response scoring programs; every item 
needed its own scoring program. The present invention uses 
the same code for an entire vignette item family. Currently 
a vignette family may consist of twenty-four individual 
items which are equivalent in difficulty and the skills tested. 
Difficulties with prior art methods. 

There are several inherent difficulties with the ARE*s 
paper-and-pencil method of test administration. In 
particular, the paper-and-pencil ARE could only be sched- 
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uled infrequently — twice a year. Many weeks were needed 
for scores to be reported to candidates because of the time 
required to plan and host a "convention-style** grading 
where many human graders were flown into a central 
5 grading location. 

The paper and pencil ARE exams were scored in large 
convention style settings. Such gradings involve finding 
skilled architects who can take time off from their work to 
serve as graders, transporting them to a central location, 
10 making hotel arrangements for all the people involved, and 
hiring and training temporary clerical staff to manage a large 
volume of secure paper. 

Humans grade less consistently than computers and are 
harder to monitor. Human grades rely on a gross holistic 
IS view of a solution which incorporates much less detail and 
precision than computer scores. 

Computer generated ratings may be superior to human 
scores because testing experts and experts skilled in the art 
of architecture can manipulate the relative impact that each 
20 feature of a solution that is analyzed has on the solution's 
final score. 

SUMMARY OF THE INVENTION 

The present invention provides a computer-based method 

25 and system for competency level assessment of profession- 
als such as architects and engineers. The invention also 
provides a new computer-based simulation of architectural 
practice. The system can replace and/or complement paper- 
and-pencil professional assessments. The system of the 

30 present invention provides for computer-based delivery and 
scoring of the examination. 

One preferred embodiment of the present invention pro- 
vides a fully computer-administered and computer- 

35 automated scoring of open-ended computer-based simula- 
tions corresponding to the earlier two "graphic" or open- 
ended questions covering Building Design and Site Design 
of the ARE examination. This preferred embodiment of the 
present invention assesses, in a realistic setting, the higher- 

4Q order skills considered essential to the competent practice of 
architecture, and in particular, the aspects of site and build- 
ing design. 

The testing system of one preferred embodiment of the 
present invention comprises three distinct functional 

45 subsystems — authoring, delivery and scoring. 

The authoring subsystem provides the functionality 
required to "author" or create and establish scoring rules and 
criteria for the test items, that is, particular vignettes. It 
allows the test creator to specify the names and attributes of 

50 spaces that will comprise a unique script. These attributes 
consist of conditions that are internal to the space itself and 
which are to be met by the candidate. 

The delivery subsystem assembles a complete test item 
for a candidate based on instructions stored in the authoring 

55 (".ant**) file which tells the delivery subsystem to reference 
various files stored in multiple formats and locations and 
how to present certain features, options, menus, and drawing 
elements to the candidate. One preferred embodiment of the 
delivery subsystem relies on item Framework software 

60 which has been compiled as a dynamic link library (".dll" 
file) and which includes a large library of computer code 
representing geometric objects that are referenced in current 
and foreseeable test items, this code may be reused, in whole 
or part, for future test items. The preferred embodiment of 

65 the delivery subsystem of the present invention interfaces 
with ETS's OPEN SYSTEMS ARCHITECTURE (OSA) 
test administration system which provides many of the 
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administrative capabilities of the present invention. ETS has FIG. 3 shows the display screen, for the Schematic Design 

a patent directed to among other things, computer systems Vignette of a preferred embodiment of the present invention, 

and methods which include OSA capabilities, it is U.S. Pat. after the Sketch Icon Tool has been selected. 

No. 5,565316, "SYSTEM AND METHOD FOR COM- FIG. 4 shows the display screen, for the Schematic Design 

PUTER BASED TESTING" which is hereby incorporated 5 vignette of a preferred embodiment of the present invention, 

herein, after the Draw Icon Tool has been selected. 

In order to score a vignette, the candidate's solution must FIG. 5 shows the display screen, for the Schematic Design 
be decomposed and then analyzed so a score can be Vignette of a preferred embodiment of the present invention, 
assigned. Decomposition is another way of saying that the wheret first> the Draw Icon Tool has t^en selected and 
graphic response of the candidate is represented in math- 10 second, the Door entry on the Draw menu has been selected, 
ematicaj I terms suitable for analysis Additionally, the scor- FIG. 6 shows the display screen for the Schematic Str- 
ing method rehes on a knowledge ehcitation and represen- ^ Desi v ^ {cmd embodiffient of the 

tation approach developed by one of the co-inventors of the _ t 

4 . rj, r j j i-i i_- present invention, 

present invention. The method produces a treelike or hier- ~~ 

archical organization of problem features needed to charac- ^ ™ G ; 7 t s !? ows ^ e ^P 1 ** for Mechanical and 

terize performance on a problem class or vignette type. Electrical Plan Vignette of a preferred embodiment of the 

t, u • ii *_ _ c j • *u * . present invention. 

There are basically two types of nodes in the scoring tree o 

hierarchy. One type consists of low-level features requiring RG 8 the dls P la y screen for ^ Building Section 

a direct computation from the solution, such as computing Vl £ nette of a P referred embodiment of the present invention. 

the location of an element, the distance between design 20 FIG. 9 shows the display screen for the Accessibility — 

elements, or counting the presence or absence or some Ramp Vignette of a preferred embodiment of the present 

elements. The second type of node consists of clusters of invention. 

lower-level features. All possible values for a cluster can be FIG. 10 shows the display screen for the Accessibility — 

represented by a two-dimensional matrix. The matrix Toilet Room Vignette of a preferred embodiment of the 

approach to summarize scores is a convenient format to rank 25 present invention. 

the feature cluster measures, and locate tuples to identify the piG. 11 shows the computer scoring decision tree for the 

combinations associated with a particular score. Accessibility— Toilet Room Vignette of one preferred 

After the vignette is scored it is sent along with informa- embodiment of the present invention, 

lion about the test item, the answer and the test taker to a 3Q pjos. 12-34 show several of the Features, including A, I 

back end process which combines the individual vignette and u scoring, for the Accessibility— Toilet Room Vignette 

scores and issues a score report for the test taker. of one preferred embodiment of the present invention. 

ADVANTAGES OF THE PRESENT INVENTION mG * 35 shows the Master Features Matrix for the 

Accessibility — Toilet Room Vignette of one preferred 

The computer interface of the present invention is pow- 35 embodiment of the present invention, 

erful and easy to learn, and yet consistent across different mQ 36 shows the Entry Door Features matrix for the 

types ot vignettes. Accessibility— Toilet Room Vignette of one preferred 

Because of the design of the computer interface of the embodiment of the present invention, 

present invention, the speed with which a candidate renders nG 37 shows ^ Handicapped Fixtures Features matrix 

a solution to a particular vignette is increased, which permits 40 for ^ Ac0M8Mit ^. lhilfit Room Vignette of one pre- 

either a shorter testing period or more vignettes to be fcrred embodiment of the present invention, 

administered in the same period of time. An increase id the _^ , 

number of vignettes permits sampling of a wider variety of nG •» the Grab Bar Features matrix for the 

skills than previously possible. Accessibility— Toilet Room Vignette of one preferred 

Other advantages of the computer-based testing of the 45 
present invention includes accuracy, consistency and quick 



embodiment of the present invention. 

FIG. 39 shows the Other Fixtures Features matrix for the 

mrn-around" tmie. *" ~" ~ ' " ** " Accessibility— Toilet Room Vignette of one preferred 

, . . . , embodiment of the present invention. 

It is an object of the present invention to provide a CTr , AA . 4l f _ . _ A „ 4 4 . c . 

computer-based system for assessment purposes, in whole . HG. 40 shows the Travel Path Features matrix for the 

or in part, of professionals and more particularly in the 50 Acc^ibih ty-Toilet Room Vignette of one preferred 

licensing and certification of architects. embodiment of the present invention. 

It is an object of the present invention to provide an A ^'V?™? * e D * sign ^ Features matrix f ? r the , 

examination for assessing professionals for licensure or AC f^ lblh 77l° llet R °? m Vl f ette ° f 006 P referred ' 

certification which has computer-based simulations which „ embod ^ ent of * e P resent ^ ven ^n. 

realistically simulate problems in architectural planning and FIG * 42 shows directions for drawing the 4" wall for 

design the Accessibility — Toilet Room Vignette. 

It is a further object of the present invention to provide for FIG - 43 ^ ^P 1 ^ for ^ e Stair Desi g n 

scoring of the computer-based simulations by computer Vignette of a prefer red embodiment of the present invention, 

algorithms that do not require further hand scoring by 60 FIG. 44 shows the display screen for the Roof Plan 

experts, except as a quality control procedure. Vignette of a preferred embodiment of the present invention. 

FIG. 45 shows the display screen for Interior Layout 

BRIEF DESCRIPTIONS OF THE DRAWINGS vignette of a preferred embodiment of the present invention. 

FIG. 1 shows a flowchart of one preferred embodiment of FIG. 46 shows the display screen for the Site Section 

the present invention. 65 Vignette of a preferred embodiment of the present invention. 

FIG. 2 shows the display screen for the Schematic Design FIG. 47 shows the index screen for the Site Section 

Vignette of a preferred embodiment of the present invention. Vignette of a preferred embodiment of the present invention. 
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FIG. 48 shows the vignette directions screen for the Site Microsoft Windows 95, or Windows NT. Educational Test- 
Section Vignette of a preferred embodiment of the present ing Service's OSA scientific calculator, 
invention. AutoCAD® OEM distributed by Autodesk, Inc., Ill 

FIG. 49 shows the program screen for the Site Section Mclnnis Parkway, San Rafael, Calif. 94903, USA. 

Vignette of a preferred embodiment of the present invention. 5 AutoCADO OEM is a computer-aided design (CAD) engine 

FIG. 50 shows the tips screen for the Site Section Vignette for , third-party developers. It is built from AutoCAD® 

of a preferred embodiment of the present invention. * clcasc 1Z 1| P™ vidcs ^ foundation for new applications 

™o ^ ^ , , „ . that require DWG compatibility. AutoCAD® OEM Release 

FIGS. 51(a) znd 51(b) show the general test Erections 2 le(s devel md CAD ^ an QEM version 

screen for the Site Section Vignette of a preferred embodi- 1Q of AutoCAD ®, t0 createj industry-specific applications, 

ment of the present invention. w . M u . . < . rr 

r Microsoft s Media View help screen viewer. 

FIG. 52 shows the display screen for the Site Analysis R ogU e WaveTools.h++ version 5.2 by Rogue Wave Soft- 
Vignette of a preferred embodiment of the present invention . ware i 

FIG. 53 shows the display screen for the Site Grading . . . « 

Vignette of apreferred embodiment of the present invention, is Invention Not Limited to Particular Vignettes 

FIG. 54 shows the vignette directions screen for the Site While the descriptions of the embodiments of the present 

Grading Vignette of a preferred embodiment of the present invention given below are generally disclosed in terms of 

invention. ~* one or another specific vignette, the present invention is not 

FIG. 55 shows the program screen for the Site Grading Umi ** d to ^ disclosed vignettes and one ordinarily skilled 

Vignette of a preferred embodiment of the present invention. 20 m the r hav « no difficulty applying the disclosures to 

. . ,_ _ j . any number of different vignettes. 

FIG. 56 shows the tips screen for the Site Grading AUTHORING SUBSYSTEM 

Vignette of apreferred embodiment of the present invention. M me name su&jBsX8§ ^ authoring subsystem provides 

FIG. 57 shows the computer scoring decision tree for the the functionality required to "author" or create and establish 

Site Grading Vignette of a preferred embodiment of the 2S scoring rules and criteria for the test items, that is, particular 

present invention. vignettes. It allows the test creator to specify the names and 

FIGS. 58-61 show several of the features, including A, U attributes of spaces that will comprise a unique script. These 

and F scoring, for the Site Grading Vignette of a preferred attributes consist of conditions that are internal to the space 

embodiment of the present invention. itself and which are to be met by the candidate. One example 

FIG. 62 shows the features matrix for the Site Grading 3° ^ square feet. The program, that is, the instruction to the 

Vignette of a preferred embodiment of the present invention. candidate as to what the candidate is required to accomplish 

FIG. 63 shows the display screen for the Zoning Section ^ res P ec ! [° a P^™ 1 " vi g ne "e, may call for a space to 

Vignette of a preferred embodiment of the present invention. * ^ an L area of a certam *P m ^ authoring 

™„ , A , . . £ . _ file will contain this space requirement, which will in turn be 

FIG 64 shows the display screen for the Site Parking 35 used b ^ ^ s ^ tf ? m to check whether or not mis 

Vignette of apreferred embodiment of the present invention. program faas becQ met ^ fof cxample> ^ 

FIG. 65 shows the display screen for the Site Design "SAMPLE AUTHORING FILE FOR THE 

Vignette of a preferred embodiment of the present invention. ACCESSIBILITY-TOILET VIGNETTE" in the Source 

FIG. 66 shows the display screen for the Block Diagram Code Appendix. 

Vignette of a preferred embodiment of the present invention. 40 A primary function of authoring is that the drawings are 

FIG. 67 shows the scoring tree or feature evaluation map used for a database of geometric information, the ".aut" files 

for the hypothetical bath remodeling vignette. are used to reference this information, and provide addi- 

FIG. 68 shows the initial bathroom display for the Hypo- ti ° nal information about how these geometric objects must 

thetical Bathroom Remodel Vignette. relate to one another m a particular script. The ".aut" file, 

„ rn . . . . . w — . . . _ . 45 therefore, is a database of all non-geometrical information. 

FIG. 69 shows a good solution to the Hypothetical Bath- ^ ^ dfy direct 

room Remodel Vignette design problem. access and primary adjacency (for example, the inter-space 

FIG. 70 shows a not so good solution to the Hypothetical relationships called for by the program), or relationships of 

Bathroom Remodel Vignette design problem. spaces t0 site amenities (for example, a kitchen may need 

DETAILED SUMMARY OF THE INVENTION 50 aCCC ^ to . f f^* 3 that deliveries can be made ' and trash 

can be picked up). 

The present invention comprises a test delivery system "View" is another feature that the scoring subsystem may 

and an automated scoring system. As described below, the be required to extract from the authoring file. That is, a room 

test delivery system is divided between the platform, i.e., may need a view of a site feature, and the fact that the 

computer hardware and computer operating system and the 55 candidates* instructional program calls for this relationship 

interface presented to the candidate, Le., the common and to exist would require the authoring subsystem to define 

unique tools provided to the candidate, with which to answer certain parameters that are used in the scoring program's 

the test assignments. See, FIG. 1 "view" formula. For instance, whether or not the view 

PLATFORM AND THIRD PARTY SOFTWARE requirement has been met may depend on the distance of the 

The delivery system for one preferred embodiment of the 60 room from the site feature, the angle of the side of the room 

present invention comprises the following equipment. An containing a window with relation to the site feature, and 

Intel Corporation 80486 cpu (or better) based persona] how many other objects, and of what type, may be placed 

computer, with video display device (monitor), keyboard between the room and site feature before an otherwise valid 

and mouse. Generally, a minimum of 8 megabytes of RAM, view is considered obscured. All of these, and similar 

though the actual amount of memory required is dependent 65 variables, are placed in the scoring authoring file. Because 

upon the operating system. Either Microsoft Windows 3.1 or they have been stored outside the compiled code in a file that 

Windows 3.11 running with Win32s 32 bit extension or can be edited with any word processor, scoring tolerances 
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can be altered quickly and easily without any re-writing or FRAMEWORK 

recompiling of computer code. The preferred embodiment of the present invention has 

While the site amenities and site features mentioned are, item Framework software which has been compiled as a a 

in one preferred embodiment, displayed to the candidate in Windows ® dynamic link library (".dll" file) and which 

the form of a AutoCad® "dwg" format, that format will not 5 includes a large library of computer code representing 

generally suffice to show all the underlying representations geometric objects that are referenced in current and fore- 

that may be needed. Therefore, the authoring subsystem tcst itcms> this code may ^ reuscd> m wholc or art> 

provides means for creating these entities^ captunog, speci- fof foJtm test items Therefore) a tn , ical v ^ nette 

fying and detailing their attributes, which wifl inchide ^ ^ additional ^ ^ d ^ ^ 

graphical and positional data, as weU as attn^utes descnbmg 1Q k ' Framework . ^ ^ £ ides a ^ of 

their transparency or opaqueness, their ability to enable or 4l _ 4 .. . . 4 . . . r . 

prevent pedestrian or vehicular access, and other parameters P ro ,f ams f» availa 1 bl€ L to ^plications at run time, 

required by the delivery or scoring subsystem, or both. . ° De b L enefit m * e Framework of the present mven- 

FinaUy, the authoring subsystem has the ability to bundle Uon * mat an interface function may have multiple uses. In 

all of this information along with all of the necessary one vi g nette il ma Y check overlaps by examining the posi- 

supporting documentation (drawings, documents) etc. that 15 non of ^ vector polygons designated as "rooms'* in that 

are used on the "reference screen", and pass this information vignette's authoring file. While in another vignette that same 

along to the delivery and scoring subsystems. interface function may be examining the position of poly- 

DEUVERY SUBSYSTEM gons which represent two angled roof planes or a sidewalk 

The delivery subsystem assembles a complete test item that is required to be adjacent to, but obviously not inside, 

for a candidate based on instructions stored in the authoring 20 a building. This function was created to avoid penalizing 

(",aur") file which tells the delivery subsystem to reference candidates who may be uneasy with a computer mouse but 

various files stored in multiple formats and locations and who nevertheless attempted to position a required element 

how to present certain features, options, menus, and drawing with the correct relationship to another site or solution 

elements to the candidate. object. 

For example, an ".aut" file may contain a reference to the 25 F ramcW ork file directory for one preferred embodi- 

relevant site background drawing and a list of those tools mcnt of mc m mvcntion includes the following subdi- 

which are specific to the test item will be available on the rcctories: RESOURCE; COMPONEN; CONTROLS; 

tool bar. It may also contain references to the location of DWG EVENTS; FEATURES; GEOMETRY; GRAPHICS; 

item specific code libraries that may be external to the main HDR; M0USETOK . 0BJS; 0SA; QSACALC; PERST- 

executing program 30 GEO: APPLICAT; SCORING; TRANSACT: VGNOBJEC; 

The primary function of this process is to allow the ' v ' ^ ' A ^^1,0 AnT-i >u 

candidate to create a solution that will satisfy programmatic, VGNTASKS; VGNWIND; and WINDOWS. While the 

code and design logic considerations. Therefore, this sub- faction of the files found m a particular subdirectory may 

system provides the candidate with the ability to draw be obvious from the subdirectory's name, nevertheless a 

spaces, and detail like doors, windows, and wall openings, brief description follows. 

and place elevators and stairs. Importantly, this subsystem 35 „ 0 Ct t> - . • r- ^ ™_ r _, 

offere the candidate the ability to draw the spaces that the Framework Software Directories For One Preferred 

script calls for. Embodiment 

In one preferred embodiment of the present invention, this RESOURCE <DIR> Windows Resource file includes 

subsystem for the schematic design type vignette (see, e.g., BITMAPS, DIALOGS, and the STRINGTABLE containing 

FIG. 2) provides the candidate with the ability to draw on a 40 Help Messages displayed on screen, 

background image that shows the site, the buildable area, COMPONEN <DIR> Object components— bags, sets, 

and the site amenities and features that they will have to nvtree code 

consider in creating a solution. See the other displays screen nnkminT p n m , , . , , r , „. 

a t ^ j CONTROLS <DIR> Standard controls code for handling 

figures for additional site amenities and features. h tt h*t 

In the schematic design type vignette embodiment, the 45 _ ~L _ ' 

delivery subsystem also provides Ihe candidate with the DWG <DIR> Interfaces with AutoCADO OEM 

ability to zoom and pan, to move spaces and detail, to computer-aided design (CAD) engine. 

measure and to sketch, and to erase. The candidate can also EVENTS <DIR> Code to handle all mouse and keyboard 

work on more than one layer, in which case, he/she can view events. 

each layer separately or view an alternate layer in a manner 50 FEATURES <DIR> Code to do feature extraction for 

(for example, a light color grey) which will allow it to be Scoring. 

used by the candidate as a template. One kind of layer which GEOMETRY <DIR> Geometry objects — includes points, 

can be viewed in this manner is a floor. lines, circles, rectangles. 

In the preferred embodiment of the present invention the GRAPHICS <DIR> Code to draw all the graphics to the 

candidate can not modify the background image. The deliv- 55 screen. 

ery subsystem of this embodiment also provides the candi- HDR <DIR> Contains the definitions for pre-compiled 

date with the ability to show or not to show a grid, to change headers 

cursors, to hide or show the site, or to hide or show alternate KJ .~j ieo™ v nm nn j . . 1 

floors MOUSETRK <DIR> DLL code to track mouse move- 

t,' , . u *u n- ment between windows. 

The delivery subsystem has the capability of limiting the 60 . 

actions a candidate may take. For example, as required by OBJS <D,R> 0b J ect fiIes created dunng compilation. 

the particular script, the system may limit doors, windows OSA <D1R> Messages used to communicate with OSA 

and wall openings from being placed anywhere except during administration. 

within a wall. OSACALC <DIR> OSA code for the on-screen calcula- 

The delivery system is not limited to the above capabili- 65 tor. 

ties. It is designed to be able to be modified to add capa- PERSTGEO <DIR> Persistent Geometry code for saving 

bilities as needed. objects to disk. 
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APPLICAT <DIR> Vignette application main loop code. 

SCORING <DIR> Scoring code to process matrix file and 
feature dictionary. 

TRANSACT <DIR> Code to process all candidate screen 
transactions to allow UNDO/REDO capability. 

VGNOBJEC <DIR> Objects common to all vignettes 
include sketch objects, full screen cursor, DWG objects. 

VGNTASKS <DIR> Tasks common to all vignettes 
include the drawing of sketch objects, rotating, measuring, 
zooming, moving, identifying, selecting, erasing. 

VGNWIND <DIR> Defines all the windows common to 
all vignettes. 

WINDOWS <DIR> Code to interact with specific 
Microsoft Windows® features, such as changing the cursor, 
accessing the timer, extracting information from the .INI 
file, and starting up a process. 

Atypical test item may rely on the Framework for 80% of 
its functionality and on new code for only about 20%. 
Framework includes a large library of computer code rep- 
resenting geometric objects that are referenced in current 
and many foreseeable test items. For example, the following 
functionality is available in one preferred embodiment: 

1. Objects that are drawn by the candidate — lines, 
polygons, polylines, circles, etc. 

2. Objects that are placed by the candidate — "dwg 
objects", which are vector objects that can be anything. 

3. "Existing objects" — objects that are part of the back- 
ground drawing, but whose whereabouts and properties need 
to be known by delivery (and/or scoring). These can be 
simple or complex geometric objects. 

Use of the Framework has a positive impact on the 
process of item creation because item creators can rely on 
the library of pre-existing objects to use in creating a future 
item. Such items include architectural object definitions, 
such as-object sizes, object scales, object colors and object 
default orientations. OSA 

The preferred embodiment of the delivery subsystem of 
the present invention interfaces with ETS's OSA system 
which provides many of the administrative capabilities of 
the present invention. While the preferred embodiment 
utilizes ETS's OSA system, there are commercially avail- 
able computer programs with enough functionality to gen- 
erally practice the administrative functions provided by OSA 
for the present invention. One example is Sylvan *s Admin- 
istrative System. 

The preferred embodiment of the delivery subsystem is 
designed to be interoperable with OSA, and could probably 
be made so with other test administration computer systems. 
Additionally, this preferred embodiment has the capability 
of compressing the candidate's solution with reference to the 
script and passing this to OSA. 

INTERFACE 

Description of Common Tools 

Common tools provide the candidate with a method for 
sketching various lines, curves and geometric objects. Geo- 
metric objects created with these are not considered in 
determining a candidate's score. Clicks refer to depressing 
and releasing one of the mouse buttons or if a pointer is 
being used, the key/bar used in conjunction with the pointer. 
In one embodiment of the present invention the tools appear 
on the left hand side of the display screen. See FIG. 3. 
Sketch Icon Tools. 
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The candidate can access the following drawing aid tools 
by selecting the icon entitled "sketch", which activates the 
"Sketch Tools" tool bar as shown in FIG. 4. See also FIG. 
5. 

5 VIEW GRID/HIDE GRID: Displays and hides light gray 
grid (not always available). 

HIDE SKETCH ELEMENTS: Toggles sketch layer ele- 
ments on/off. 

MEASURE: Gives the candidate the ability to measure 
10 distances, by clicking on 2 points (click to specify start and 
end points), in either feet and inches or meters, depending 
upon which system of measurement is being employed in 
the particular examination. 

LINE: Draws sketch lines by clicking to specify the start 
15 and endpoints of the line. 

CIRCLE: Draws circles by clicking to specify the center 
of the circle, then another click to specify the radius. 
ORTHO Icon Tool. 
The orthogonal tool forces all lines or polylines to be 
20 drawn horizontally or vertically, but not diagonally. 
ZOOM Icon Tool. 

When the candidate has selected the ZOOM icon tool, 
he/she can then select an area of the screen he/she wants to 
magnify by clicking once on the drawing to specify the start 
25 point, and clicking a second time to specify the end point of 
the zoom box. The magnification of the zoom depends on the 
size of the zoom box. A smaller box gives the candidate 
greater magnification than a larger box. 
CURSOR Icon Tool. 
30 The candidate by selecting the cursor icon tool can toggle 
between an AutoCAD®-style cross-hair cursor and a small 
cursor. 

UNDO Icon Tool. 
Clicking on this icon allows the candidate to undo the last 
35 change they made to their solution. Clicking a second time 
restores the last change. 
ERASE Icon Tool. 

The candidate selects this icon, then selects a drawn or 
placed object(s), by clicking on the erase icon tool again the 
40 object(s)*are erased. 
ID Icon Tool. 

The Id icon tool when selected displays the name and/or 
the dimensions of all placed and drawn objects. The candi- 
date selects this icon, then selects a drawn or placed object. 
45 The requested information will be display in the Information 
Window. 

CALC Icon Tool. 
When the candidate selects the Calc or calculator icon 

tool, a calculator is displayed on the screen. The displayed 
50 calculator performs the mathematical calculations necessary 

to respond to the requested task. Such functions include sine, 

cosine, tangent, arcsine, arccosine, arctangent, etc. 

TASK INFO Icon Tool. 

Selection of the Task Info icon tool, enables the candidate 
55 to toggle back to the Task Information screen discussed 

below. It functions the same as hitting the spacebar. 

Start Over Icon Tool. 

Selecting the start over icon tool clears the drawing 

completely and allows the candidate to begin anew. 
60 REVIEW Icon Tool. 

The Review icon tool has two functions, it is used first, to 

both exit out of the vignette and proceed to the next test 

vignette, if any, and second, to review a prior vignette. 

(Another embodiment of the present invention uses a 
65 "Done" icon tool which only permits the first function.) If 

the candidate selects the Review icon tool once, the message 

in Information Window provides the candidate with a sec- 
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ond chance to stay in the vignette by selecting any other 
icon, or to click on the Review icon tool again to exit to the 
next vignette or from the examination. 

Description of Unique Tools 

The following tools appear on one or more vignettes and 
each of the tools listed below can be found in various 
combinations throughout all vignettes. See FIG. 3. 
CHECK Icon Tool. 

Selecting this icon brings up a menu of options that may 
include: 

CHECK OVERLAPS: 

This tool is used to detect any overlapping elements, for 
those vignettes which allow for this check. Since some 
vignettes allow the candidate to provide a response with 
overlapping elements, in one preferred embodiment this tool 
would not be available on those vignettes. In one preferred 
embodiment, overlapping elements appear in pink. 
CHECK CUT TREES: 

When elements are placed over existing trees, the trees are 
flagged as "cut trees" when this icon is selected. 
DRAW Icon Tool. 

Selecting this icon brings up a menu that displays lists and 
sub-lists of items to be placed or drawn, such as buildings, 
trees, roads, grades, parking spaces, rooms, etc. In the 
preferred embodiment of the present invention, this tool is 
available except for B3 Grading (see FIG. B3). 
MOVE,ADJUST Icon Tool. 

This tool is used to move and adjust placed or drawn 
objects. The candidate selects this icon, if he/she clicks 
while the cursor is on an edge of a drawn object and drags 
the cursor across the screen, the size of the object will adjust 
accordingly. But if the candidate selects this icon, then clicks 
when the cursor is within the object and drags the cursor 
across the screen, it will move the drawn or placed object as 
a whole. 

MOVE GROUP Icon Tool. 

Tnis tool allows the candidate to move more than one 
placed or drawn object at a time, while retaining their 
alignment and placement. The candidate selects this icon, 
then click on the objects he/she wants to move, then clicks 
on Move Group again to move them. 
ROTATE Icon Tool. 

This tool is used to rotate placed or drawn objects. In one 
preferred embodiment of the present invention, the tool 
rotates some objects in 90-degree increments; rotates others 
in 15-degree increments. 
LAYERS Icon Tool. 

Selecting this icon brings up a menu that lists the various 
layers of information that can be turned on/off, that is, 
displayed or not displayed. Options on this menu are vari- 
able with each vignette and may include: 
HIDE BUILD ABLE AREA: 

This allows the candidate to temporarily hide a buildable 
area that he/she drew. 

HIDE SECONDARY CONSTRUCTION AREA: 

This allows the candidate to temporarily hide a secondary 
construction area. 
HIDE SITE: 

Hides entire base drawing. 
HIDE OTHER FLOOR: 

Hides either floor 1 or floor 2. 
SET ROOF Icon Tool. 

This icon tool allows the candidate to define a roof plane 
by setting slope direction, slope ratio, elevation vertex, and 
elevation value. This icon is selected after plane is drawn. 
The following features are available after the "Set Roof 
icon is selected: 
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Slope Direction: "The way the water falls." The arrow 
points in the direction the roof plane slopes. To set 
slope direction, the candidate clicks on Set Roof, then 
clicks on slope arrow until desired direction is 
achieved. In one preferred embodiment, each click 
rotates arrow 45 degrees. Slope Ratio: Rise: Run. This 
ratio defines the height that the roof plane will rise, per 
specified horizontal distance across. To set the slope 
ratio, the candidate clicks directly on slope ratio dis- 
played within the plane. 
Elevation Vertex: This is the vertex of the plane for which 
the elevation is assigned. By clicking on any point 
within the plane (except on slope arrow, ratio or eleva- 
tion value), the location of the vertex will move clock- 
wise by one vertex. 
Elevation Value: Allows setting the elevation of the plane 
at the elevation marker. This is the height of the plane 
at a given vertex. The value is entered in feet and inches 
(when the English system is used), by moving up/down 
arrows to desired value. To enter value, the candidate 
clicks on displayed elevation value. Elevations for all 
other vertices are automatically calculated. 

Icons for Another Embodiment 
25 Another embodiment of the present invention has the 
following icon tools in addition to some or all of the 
proceeding ones. 
DONE Icon Tool. 

The DONE icon tool is used to exit out of the vignette and 
30 proceed to the next test vignette, if any. If the candidate 
selects it once, the message in Information Window provides 
the candidate with a second chance to stay in the vignette by 
selecting any other icon, or to click on the DONE icon tool 
again to exit to the next vignette or from the examination. 
35 OPTIONS Icon Tool. 

Selecting this icon brings up a menu of options (variable 
with each vignette) that may include: 

1. CHECK OVERLAPS: 

Used to check overlapping elements. In one preferred 
40 embodiment, overlapping elements appear^in pink. - 

2. CHECK CUT TREES: 

When elements are placed over existing trees, the trees are 
flagged as "cut trees" when this icon is selected. 

3. HIDE BUILDABLE AREA: 

45 This allows the candidate to temporarily hide a buildable 
area that he/she drew. 

4. HIDE SECONDARY CONSTRUCTION AREA: 

This allows the candidate to temporarily hide a secondary 
construction area. 
50 5. HIDE SITE: 

Hides entire base drawing. 

6. HIDE OTHER FLOOR: 
Hides either floor 1 or floor 2. 

7. SET ROOF: 

55 Allows the candidate to define a roof plane by setting 
slope direction, slope ratio, elevation vertex, and elevation 
value. This icon is selected after plane is drawn. The 
following four (4) features are available after the "Set Roof 
icon is selected: 
60 8. Slope Direction: "The way the water falls." The arrow 
points in the direction the roof plane slopes. To set slope 
direction, the candidate clicks on Set Roof, then clicks on 
slope arrow until desired direction is achieved. In one 
preferred embodiment, each click rotates arrow 45 
65 degrees. 

9. Slope Ratio: Rise:Run. This ratio defines the height that 
the roof plane will rise, per specified horizontal distance 
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across. To set the slope ratio, the candidate clicks directly 
on slope ratio displayed within the plane. Elevation Ver- 
tex: This is the vertex of the plane for which the elevation 
is assigned. By clicking on any point within the plane 
(except on slope arrow, ratio or elevation value), the 
location of the vertex will move clockwise by one vertex. 

10. Elevation Value: 
Allows setting the elevation of the plane at the elevation 

marker. This is the height of the plane at a given vertex. The 
value is entered in feet and inches (when the English system 
is used), by moving up/down arrows to desired value. To 
enter value, the candidate clicks on displayed elevation 
value. Elevations for all other vertices are automatically 
calculated. 

11. SWITCH FLOORS: 
Used to toggle between floors 1 and 2. 

12. MOVE ELEVATION MARKER: 
Used to move the elevation marker from vertex to vertex. 

ROTATE SITE Icon Tool. 

This tool is used to rotate the entire site. 
ROTATE SKYLIGHT Icon Tool. 

This tool is used to rotate a skylight already in place. In 
one preferred embodiment, it rotates the skylight in 90 
degree increments. 

VIEWING WINDOWS 
Information Window. 25 

The Information Window, is used to inform the candidate 
of object names, sizes of objects, and distances between 
objects. It is also used to warns candidates before they carry 
out potentially destructive commands such as "erase", "start 
over" and/or "review". 30 
Help Window. 

The Help Window is used to inform the candidate of what 
actions are available at any given time. As the candidate 
works through interactions that require on or more clicks, 
the Help Window is updated to inform them what they can 3S 
do next. In one preferred embodiment of the present 
invention, it is horizontally oriented along the bottom of the 
screen. 

Work Window. 

The Work Window, is the large window in the center of 
display screen. It shows the initial template picture onto <4 ° 
which the candidate enters his or her solution. The initial 
picture may contain site features that the candidate must take 
into account when planning his or her solution, including 
existing trees, roads, protected wetlands, or bordering prop- 
erties. See for example, FIG. 2. 45 
Task Information Screen. 

Selection of the Task Info icon tool, enables the candidate 
to toggle back to the Task Information Screen. The task 
information screen provides the name of the vignette as well 
as links (areas to click on) to the informational screens. Once 50 
at an informational screen clicking on the INDEX icon takes 
the candidate back to the Task Information Screen. 

Informational Screens 
Vignette Directions Screen. 

See, for example, FIG. VIGNETTE DIRECTIONS. Pro- 55 
gram Screen. 

See, for example, FIG. PROGRAM. 
Tips Screen. 

See, for example, FIG. TIPS. 
General Test Directions Screen, 

See, for example, FIGS. GENERAL TESTa and GEN- 
ERAL TESTb. 

SOLUTION SCORING SYSTEM 
Scoring Method Generally 
In one preferred embodiment of the present invention, the 
test consists of three divisions. Each are composed of three 
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to six vignettes. Each vignette addresses a number of tasks 
or knowledge skills, and abilities related to building and site 
design that were identified by a task analysis of the field of 
architecture. The vignettes of the present invention thor- 
oughly cover the areas designated as most important by the 
task analysis. In a preferred embodiment of the present 
invention, each candidate taking a vignette is likely to 
receive a different problem from a pool of psychometrically 
equivalent problems. 

The site design vignettes look remarkably similar to those 
found in the paper-and-pencil test. The interface between the 
candidate and the computer was designed with the computer 
novice in mind. The candidate may interact with the vignette 
through the use of a computer mouse or other pointing 
device or the keyboard. The candidate chooses tools such as 
"Draw" or "Move" by selecting icons on the computer 
screen. 

The simulations that test skills in building and site design 
require the availability of many materials, such as programs, 
codes, drawings, and other resources usually found in an 
architect's office. The computer-based test of the present 
invention provides the essential materials to the candidate, 
as needed, at the click of an icon or the press of the keyboard 
space bar. 
Decomposition. 

In order to score a vignette, the candidate's solution must 
be decomposed and then analyzed so a score can be 
assigned. Decomposition is another way of saying that the 
graphic response of the candidate is represented in math- 
ematical terms suitable for analysis. 

Decomposition for simulations of the present invention is 
much different than that for figural response. In figural 
response the system need only check for the presence of the 
correct response. Whereas in simulations of the present 
invention the system must be able to deal with an almost 
infinite number of responses. 

Vignette scoring systems in accordance with the present 
invention will generally include, depending on the particular 
vignette and to a greater or lesser extent, the following 
features, some of which may overlap in functionality. 
Vignette scoring systems may: 

1. Assess completeness of the candidate's response by 
verifying that the candidate has performed all required 
operations. This is often done as part of a "fatal flaw" 
check. 

2. Determine grammatical correctness (or design 
grammar) of the solution by verifying that the candi- 
date has respected all of the vignette's program con- 
straints in the responses. A failure to be grammatically 
correct will generally constitute a 'fatal flaw" and 
result in an unacceptable score for the vignette. 

3. Identify superfluous response components, in those 
cases where the interface permits superfluous 
responses, by examining the response of the candidate 
for unnecessary or ineffective action. 

4. Verify satisfaction of the test program by examining the 
response of the candidate for compliance with the 
requirements of the vignette. 

5. Check technical correctness by assessing the response 
of the candidate for satisfaction of the technical 
requirements associated with the vignette, for example, 
code compliance. 

6. Evaluate the efficiency and design logic by determining 
the level of skill and ability of the candidate as exhib- 
ited by the quality and efficiency of the solution. 
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Scoring Trees. mation. Data collected from field trials can be used to 

The scoring.method relies on a knowledge eKcitation and suggest further changes. For example, some features may be 

representation approach developed by one of the found not to function well, or be ambiguously defined, or 

co-inventors of the present invention. The method produces computationally infeasible as originally conceived. Any 

a treelike or hierarchical organization of problem features 5 potential changes are considered very cautiously because all 

needed to characterize performance on a problem class or the other instances of the vignette type must be considered 

vignette type. As an illustration consider the design problem in order to avoid the introduction of instance ^specific scor- 

of planning a bathroom displayed in FIG. 10. ing considerations. Occasionally, from such considerations 

This is what the candidate would see on the computer emerges a need to revise the specifications. For example, the 

screen with the icons on the left serving as the interface for 10 initial specifications for the vignette type concerned with 

the candidate to enter and solve the problem. By pressing the lighting and ventilation allowed for the possibility of one or 

space bar on the computer keyboard or by selecting the Task two air supplies and returns. After data was collected on this 

Info icon the candidate can refer to the problem to be vignette type, this flexibility was found to be problematic 

resolved as well as access relevant reference material. Click- and eliminated, 

ing on the Draw icon offers the candidate a menu of design 15 

objects that can be placed in the solution, such as a bathtub, Soonn 8 Me,ho f to < Architects 

toilet, etc. The other icons allow the candidate a series of xamina on 

actions to refine the solution, such* as moving and rotating In a typical vignette exercise, the salient features of a 

the different design elements. candidate's solution are extracted and promulgated through 

Scoring trees are formulated initially as a top-down 20 a hierarchical or "tree-like" scoring structure from which a 

process where the relevant professional, for example, score for the solution is generated. For example, see FIG. 11, 

architects, based on their experience grading open-ended which is the scoring feature tree for the Accessibility Toilet 

problems in the paper-and-pencil test, formulate broad cat- vignette. This tree structure is composed of several critical 

egories that characterize the solution to a type of problem. primitive features, each of which feeds into a higher order 

The broad categories, for example, design logic, are not 25 feature — called a cluster or sub-cluster— which in turn feeds 

directly computable from the representation of a solution into either a higher order cluster or the vignette's title 

and, therefore, need to be fleshed out into more basic cluster." See, NCARB, 1994, p. 1, the entirety of which is 

characterizations that are, in fact, computable. The process hereby incorporated herein. 

is arduous and it involves, in addition to the relevant For example, as disclosed in FIG. 11, "Width" (Feature 1 

professional, computer scientists and test developers. The 30 (see FIGS. 12 and 13), weight 2, possible scores of (A), (1) 

inventors have found that a hierarchical tree representation or (U)), "Latch Clearance" (Feature 2 (see FIG. 14), weight 

is both a natural and convenient form of knowledge elici- (or multiplier) 1, possible scores of (A), (I) or (U)) and 

tation. "Virtual Clearance" (Feature 3 (see FIG. 36), weight 1, 

Scoring Tree Nodes, Clusters, Features and Classifica- possible scores of (A), (I) or (U)) are the critical primitive 

tions. 35 features, which feed into the higher order cluster "Entry 

There are basically two types of nodes in the scoring tree Door" (Matrix 2 (see FIG. 36), weight 1), which in turn 

hierarchy. One type consists of low-level features requiring feeds into the vignette's title cluster the "Accessibility 

a direct computation from the solution, such as computing Toilet" (Matrix 1 (see FIG. 35). Some primitive features 

the location of an element, the distance between design have possible scores of only (A) or (F). See "Room Con- 

. elements, or counting the presence or absence or some 40 figuration" Feature 21, FIGS. 11 and 34. While some primi- 

elements. The outcome of each feature is a classification into tive features have possible scores of only (A) or (U). See 

one of four categories: Acceptable (A), Indeterminate (I), FIG. U regarding F13. However, note that in another 

Unacceptable (U) and Fatal (F). Initially the thresholds for embodiment, this feature has possible scores of (A), (I) and 

the categories are set judgmentally, based on the collective (U). See FIG. 26. 

expertise of the professionals, for example, architects 45 Extraction. 

involved in the project. As data is collected, however, the Scoring works by first reading feature requirements from 

thresholds are revisited and adjusted as necessary. The an authoring file (see "SAMPLE AUTHORING FILE FOR 

system and method of the present invention may also use the ACCESSIBILITY-TOILET VIGNETTE" in the Source 

following category: Special Processing Required (Q), which Code Appendix) and comparing the requirements against the 

is a sort of quality control feature indicating that human 50 data in a candidate's solution file. Second, running the 

oversight may initially be necessary when scoring a parti cu- feature checking subroutines and arriving at a score this is 

lar feature. called "extraction". The scoring program generates a score 

The second type of node consists of clusters of lower- of Acceptable (A), Unacceptable (U), Indeterminate (I) or 

level features. Again, the lower level clusters are subsumed Fatal (F) for each feature that it extracts. See FIGS. 11-34. 

under a given higher cluster which is already completed. 55 See also FIGS. 57-61 for another embodiment of the present 

Indeed, the computation of a vignette score proceeds from invention. The scoring program in another preferred 

the computation of the lower-level features upward in the embodiment may also generate a score of Special Processing 

order dictated by the tree. Required (Q). 

Scoring Matrices. Matrix calculation. 

All possible values for a cluster can be represented by a 60 Each individual feature that is scored belongs to a matrix, 

two-dimensional matrix where the rows refer to the number which is a collection of related features. See, for example, 

of I's and the columns refer to the number of U's. FIG. 62. For another example, the "wind", "solar" and 

The matrix approach to summarize scores is a convenient "trees" features all might belong to the "environmental" 

format to rank the feature cluster measures, and locate tuples matrix. Each feature in a matrix is assigned a weight in an 

to identify the combinations associated with an A, I or U 65 authoring file which tells the scoring program how much 

score. The initial process is modified or revisited each time that particular feature contributes to the score for that matrix, 

there are changes in problem specifications or other infor- Each matrix has a ctut score associated with it that tells how 
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many scores of an appropriately weighted (I) or (U) the various setbacks, for example, a setback of five feet from the 

underlying features of a matrix can have before the matrix edge of the site. Therefore any structure to be built on the 

score itself no longer qualifies as an (A) and must be scored site must be at least five feet away from all site boundaries, 

as an (I) or (U). In one preferred embodiment, there are two a computer implemented method to determine success in 

cut scores, one between A and I and the other between I and 5 conforming to setback requirements must determine if any 

U. The feature scores are weighted as described above Hoes defining the new structure intersect any setbacks. To be 

before they are tallied. While a matrix is generally made up coosis tent with the practice of approximating an arc by a 

of features it may also consist of other "sub^matrices each ^ of line segmentS) it & neC essary to provide 

or which have their own features. See, for example, FIGS. a means ^ G enera t e a \ onal a roximation to a iven 

35-41. When all the features have been extracted and the 10 & means ° ? e °^ ra ^ a P°y£ ona approxima ion o a given 

, . i i * j ,i j . polygon which is the setback to the given polygon, 

matrix scores have been calculated they are aggregated into r J& & v J& 

one overall score. This overall aggregation involves apply- ^ program set forth at section SETBACKS SOURCE 

ing cuts and weights to each of the underlying matrix scores CODE of the Source Code Appendix discloses one embodi- 

that have been calculated. ment of this method. 

Authoring files (".aut"). 15 For additional information the reader is directed to Reid- 

Authoring files (".aut") contain information need for both Green (1996c), which is hereby incorporated herein. 

delivery and scoring A Computer Method for Determining Building Insolation 

Certain authoring files contain feature criteria. These files s nac j ow 
answer questions such as: (i) if shading is required, how 

much shading is enough?; (ii) if two building elements must 20 ^ P*Tpo™ of this method and its underlying algorithm 

be "close" to each other, how far is too far for a score of 15 t0 venf y mat a new building is located so that it will not 

"acceptable"?; or (iii) if there is a tolerance for imprecise cast shadows on existing buildings during business hours, 

drafting, how large is that tolerance? For an example of a This and otner questions dealing with sunlight and shadows 

delivery authoring file see, "SAMPLE AUTHORING FILE can be determined from the apparent motion of the Sun on 

FOR ACCESSIBILITY-TOILET VIGNETTE" in the 25 the solstices, approximately June 22nd and December 22nd. 

Source Code Appendix. For additional information the reader is directed to Reid- 

Scoring matrix files (".mtx"). Green (1996a), which is hereby incorporated herein. 

Scoring matrix files contain matrix information. These A Computer Method for Verification of Wheelchair Acces- 

files contain matrix information such as: (i) how much is a sibility in an Office. 

particular feature weighted, vis-a-vis other features in the 30 ^ *. t - , 

matrix; or (ii) how many feature scores of (I) or (U) are . ™ e P«£°« °* me * od a ° d lts ^deriving algorithm 

necessary for the matrix to get an (I). See, for example, the 15 to venf y that the de$l ^ of an office 15 such that a 

B3S.MTX file in the Source Code Appendix which relates to wheelchair user can move around in it. Specifically, it must 

the Site Grading Vignette. ^ e possible for the wheelchair to have a free path to the 

Scoring Techniques. 35 telephone, computer terminal, etc., and it must be possible to 

In order to score solutions for certain vignettes, certain the wheelchair around. For additional information as to 

techniques had to be developed in order to represent the one embodiment of such a computer method, the reader is 

features of current and potential vignettes and the solution directed to Reid-Green (1996b), which is hereby incorpo- 

provided by the candidate in a fashion amenable for com- ratet * herein. 

puter manipulation. Several computer methods were devel- 40 « 
oped by one or more of the co-inventors of the present DETAILED DESCRIPTION OF ONE 

invention and they are described below. PREFERRED EMBODIMENT: THE 

A Computer Method For Determining If an Object Can Be ACCESSIBILITY — TOILET ROOM VIGNETTE 
Viewed From Another Object. 

It is necessary in designing public structures to consider 45 Description of a Vignette 

what can or cannot be seen from a specified building or other 

object, called the Source Object. In particular, an architect The Accessibility — Toilet Room Vignette is set as a 

must consider the question of whether the Target Object is design development problem that assesses a candidate's 

visible or obscured, depending on the desirability of seeing ability to plan one or more accessible toilet rooms within the 

the Target Object. For example, an unobstructed view of a 50 context of a given area. The exercise tests the candidate's 

park may be desirable, whereas it may be preferable not to ability to apply design logic and meet the requirements of a 

see a parking lot. simple program, as well as to interpret accessibility code 

A two-dimensional computer method is disclosed in the requirements in the development of space plans, 
program set forth at section VIEW SOURCE CODE of the „, ... t . . 4 . „ . c , . , 
Source CbdeAppendix for determining the percentage of the 55 ™ e * »™> ** *™ P lan ° f an undeveloped 

Target Object that is visible from one side of the Source area a ^g ^h adjacent comdor(s) in the building where 

0 ,r J one to three toilet rooms are to be located. The footprint of 

f- jj'j • i i* t - tU j j • . * . n *j this area is of a predetermined size and configuration. The 
For additional information the reader is directed to Re id- ... r . . , - _ . f „ 

„ nnn ,„ ,. , . , , . . , , . provided program includes fixture requirements as well as a 

Green (1996d), which is hereby incorporated herem. % . Y Jr - ♦ j *. *• i -*u 

a ^ * w *u j r r> i i *■ o *u t ti i ^ clear indication of expected functional performance with 

A Computer Method for Calculating Setback Polygons. 60 ... • * l • i , * 

Id architecture, a setback is an area, generally Ascribed £ Spe ?i < \ V,eW '^f ? Y • J * a 

, r> « «. , *> - . i mj- j i * be selected, manipulated, and placed using icons provided 

by a fixed distance from a site feature-a building, road, lot . , , , , . * n ^ r . & „ , r A . , 

line, etc.-inside which do structure may be built A setback m =! u *f P 1 "" 1 *"* ^s, accessories, wall elements with 

can be defined as the locus of all poinfs which are a fixed whlch t0 construct ** P lan ' and s^h. 
distance outside or inside an arbitrary polygon. 65 The candidate must design the space or spaces as required 

For example, consider a site plan with existing structures and place all walls, fixtures, accessories, and doors neces- 

such as buildings, driveways, etc., and the definition of sary to complete the floor plan. 
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The candidate's solution is analyzed for completeness, 
accuracy, and compliance with code and program require- 
ments. 

Required Materials for Vignette 

a) Scenario for the vignette. 

b) Statement of program objectives including functional, 
fixture, and screening requirements along with all other 
pertinent background information. 

c) Code requirements and restrictions as applicable. 

d) Floor plan of pre-configured area to be developed 
showing its relationship to the adjacent corridor(s). Outside 
walls of corridors should be indicated by double solid lines. 

e) Graphic tools for drawing walls, fixtures, accessories, 
and doors; 

Authoring Requirements of Vignette 

a) The program space to be developed should be between 
320 and 430 square feet [30-40 m 2 ], reasonably confined, 
but sufficient to allow for multiple correct solutions (square 
footprints permit the greatest variety). This space should be 
indicated by double dashed lines on the floor plan. 

b) One to two sides of the program area must be adjacent 
to a corridor along their full length. 

c) Program area should be adequate for inclusion of 
fixtures and accessories required by program and code. 

d) Required fixtures and accessories must include a total 
of 1-2 accessible showers or an infant changing tables. 

e) 9 to 12 plumbing fixtures should be required. 

f) One to three toilet rooms should be required, and at 
least one of the toilet rooms should be an accessible toilet 
room. 

g) "view screening should be required. 

h) All measurements should be in multiples of 2 inches 
[50 mm] and the plan should be on a 2 inch [50 mm] grid. 40 

Technical Overview 

Authoring: See sample authoring file entitled "SAMPLE 
AUTHORING FILE FOR ACCESSIBILITY-TOILET 45 
VIGNETTE** in the Source Code Appendix, which contains 
delivery information, but no scoring information. 

Smart Delivery: All room labels should be used before the 
candidate is permitted to leave the vignette. 

Interface: Draw The candidate must both draw and place 
elements in this vignette. 

Elements Which Are to Be Drawn or Placed. 
4" Wall (called 100 mm wall in metric vignettes) 
8" Wall (called 200 mm wall in metric vignettes) 
Doors 
Grab Bar 
Lavatory 

Handicapped Lavatory 
Room Labels 

Shower (or bidet, depending on script) 
Stall 
Urinal 

Handicapped Urinal 
Water Closet 
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Handicapped Water Closet 
Breakdown of Each Element. 
4" Wall 

The 4" wall is drawn in the way described in FIG. 42. 
8" Wall 

Same as for 4" Wall above and in FIG. 42, only wider. 
Doors 

All possible orientations and swings should be available. 
A secondary pop up should allow selection of widths from 
20 to 48 inches, in 4 inch increments. Allow an unlimited 
number to be drawn. 
Grab Bar 

Grab bars should be .dwg objects, 3'6" in length, with wall 
connectors. The rotate icon will rotate grab bars 90 degrees 
at a time to the desired orientation. Allow an unlimited 
number to be drawn. 
Lavatory and Handicapped Lavatory 

Both are .dwg objects. The rotate icon will rotate the 
lavatory 90 degrees at a time to the desired orientation. 
Allow an unlimited number to be drawn. 
Room Labels 

This option will allow the candidate to place a literal from 
a pop up menu to each created toilet room. If possible, the 
actual literal should be visible when animated into position. 
Allow only one of each to be placed. 
Shower 

Shower is a dwg object. The rotate icon will rotate the 
shower 90 degrees at a time to the desired orientation. Allow 
an unlimited number to be drawn. 
Bidet 

Bidet is a .dwg object. The rotate icon will rotate the bidet 
90 degrees at a time to the desired orientation. Allow an 
unlimited number to be drawn. 
Stall 

Stall is a rubberbanding double walled box with 1" 
between the walls at all magnifications. When doors are 
placed on a stall, they should cause a break in the wall. When 
the wall of a stall overlaps an existing or drawn wall, the stall 
wall should disappear. Allow an unlimited number to be 
drawn. 

Urinal and Handicapped Urinal 

- Both are .dwg objects. The rotate icon will rotate the 
urinal 90 degrees at a time to the desired orientation. Allow 
an unlimited number to be drawn. 
Water Closet and Handicapped Water Closet 

Both are .dwg objects. The rotate icon will rotate the 
water closet 90 degrees at a time to the desired orientation. 
Allow an unlimited number to be drawn. 
Move/Adjust 

The move icon will allow the candidate to move any .dwg 
objects, or move or adjust any drawn objects (like stalls, 
walls). 

As stalls are drawn orthogonal boxes, the candidate 
should be able to grab any wall and drag. 

Walls have a fixed width, so only the length should be 
adjustable. 
Move Group 

To work as usual: objects are selected individually, moved 
as a group. 
Rotate 

To rotate .dwg objects 90 degrees. 
Icons 

The standard set of icons common to all vignettes should 
appear as well, see FIGS. 2-10, 43-49, 52-53, 63-66. 
Grid Snap 2 inches. 

ACCESSIBILITY— TOILET ROOM FEATURES 
Certain of the Accessibility — Toilet Room Vignette prob- 
lem features were discussed in the earlier section entitled 
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Solution Scoring System. A detailed discussion of the fea- for each feature in a vignette's scoring tree are derived and 

tures for one preferred embodiment of the present invention refined iteratively through expert judgment (i.e. the judg- 

follows below. ment of architect practitioners and educators with consider- 

F1GS. 35-41 show the Master Features Matrix and feature able knowledge and experience in examination scoring 

cluster matrices for one preferred embodiment of the 5 procedures). 

Accessibility-Toilet Room Vignette. Factors such as screen resolution and grid snap values, as 

well as possible variations in expert opinion, are typical 

ANOTHER PREFERRED EMBODIMENT THE considerations in determining these values. 

HYPOTHETICAL BATHROOM REMODEL The second feature (F2) below cluster M7 checks the 

VIGNETTE io distance between the centerlineof the toilet and a wall or any 

Scenario. obstruction to either side. If the nearest face of a wall, fixture 

The candidate is instructed to re -design a master bath- or cabinet is a perpendicular distance of 15" or more from 

room starting with a pregutted floor plan; using the drawing the centerline of the toilet, an "A** is assigned to this feature, 

tools provided and using all the fixtures, cabinets and If the nearest face is between 14" and 15" from the 

lighting given in the program. See FIG. 68. is centerline, an "I" is assigned. Any condition closer than 14" 

Program. is assigned a "U". 

On the given floor plan the candidate is instructed to place If we assume that FIG. 69 shows a toilet located so that 

the following cabinets, fixtures and accessories: its centerline is 18" from both the nearest wall on one side 

1. 60" x30" Bathtub; and the end of the vanity on the other. This feature, therefore, 

2 Toilet* 20 satisfies the condition for an "A". Likewise. Assume, that 

3. 30- 4iexl8" deep freestanding linen cabinet; Se ^*J l ! a ««^ ^ wndMwi for an "A". 

* a™ ■ u j ,o,,j xr r> v . The third feature (F3) below cluster M7 checks for the 

4. 42" inch widexlS" deep Vanity Cabinet; Kquired dearance ^ ^ of ^ ^ ^ feature ^ 

5. Sink; b e to illustrate the occasional instance where an inde- 

6. 3 recessed incandescent ceiling Lighting Fixtures; and 2 s terminate category is considered inappropriate or unneces- 

7. Fuzzy Rug and Toilet Seat Cover. sary by experts. In this case, an "A" is assigned if the nearest 
Scoring. face of a wall, fixture or cabinet is a perpendicular distance 

The scoring tree or feature evaluation map used to evalu- of 29" or more in front of the toilet. Any condition closer 

ate the solutions is shown in FIG. 67. The first branch or than 29" is assigned a "U". In this case, therefore, there are 

cluster from the left (M2) comprises features relating to the 30 only two possible scores which can be assigned "A" or "U", 

plumbing fixtures to be located in the remodeled bathroom. that is, there is no "I" score. Again, assume Solution A is 

The second and third clusters (M3 and M4) comprise assigned an "A", and Solution B is assigned a "U" for this 

features relating to the placement of accessories and condition. 

cabinets, respectfully. Those features relating to the location The three features scored above are the primitives of 

of lights are evaluated in the fourth cluster (M5). The fifth 35 subcluster M7. All of the primitives below each subcluster 

cluster (M6) comprises features relating to the completeness or cluster are evaluated in a similar fashion, each having its 

of the solution. Located below the Fixtures cluster (M2) are own set of scoring rules to determine the appropriate thresh- 

three subclustcrs labeled Toilet (M7), Lavatory (M8) and olds and tolerances. The result is an assignment of a score 

Bathtub (M9). Below each of these three subclusters are category (A, I or U) for each individual primitive, 

several features which must be scored first in order to 40 The next step in the scoring process is to combine the 

subsequently determine a score for the subcluster. scores assigned to the primitives with each other to generate 

As noted earlier, scoring procedure employs a system of a score category for their respective subcluster or cluster. In 

three ordered categories. These categories correspond to the order to do this, a weighting value must be assigned to each 

insertion of an intermediate, or ^determinate, category (I) of the previously scored features for the purpose of defining 

between the clearly acceptable (A) and the clearly unaccept- 45 the importance of each feature in relation to the others within 

able (U). Hence, a designation of "A** indicates the demon- the same cluster or subcluster. In the example discussed 

stration of an acceptable level of ability; "I" indicates a level above, the features comprising subcluster M7 (Fl, F2 and 

of ability that is neither clearly acceptable nor clearly F3), must be weighted in relation to each other before they 

unacceptable; and "U" indicates an unacceptable level of can be combined to produce a score for subcluster M7. 

ability. 50 According to the scoring tree (FIG. 67), the experts have 

The first feature (Fl) below the Toilet subcluster (M7) determined that feature F3 (Front Clearance) is more impor- 

evaluates whether or not the back of the toilet is located tant that features Fl and F2. As a result, feature F3 is double 

adjacent to a plumbing wall. In so doing, the scoring system counted, or given a weighting value of two (2), against a 

searches the solution for a toilet. If one is found, the system value of one (1) each for features Fl and F2. 

determines whether or not its back is within an acceptable 55 The possibility of three (3) score values (A, I or U) each 

distance from a plumbing wall (with a stack vent indicated). for features Fl and F2 and two (2) score values (A or U) for 

If the back is either between 3" and 6" away or up to 1" into feature F3 results in a range of 18 possible combinations, 

the wall, an "I" is assigned. each of which results in a score category for subcluster M7. 

The feature is assigned a "IT if the condition is other than Each combination can be summarized by the counts of any 

those formerly described. In a first hypothetical solution 60 two of the three possible values. Therefore, all possible 

(FIG. 69), the back of the toilet is placed on the face of the combinations of "U"s and "I"s are plotted on a two dimen- 

wall in which an existing vent stack is indicated. Thus, the sional matrix, where the rows refer to the number of T's and 

scoring system assigns an "A" to this feature. the columns refer to the number of "U M s. See FIG. 67 (M7). 

In a second hypothetical solution (FIG. 70), the back of Each cell in this matrix is associated with a score for 

the toilet is located adjacent to a wall with no vent stack 65 subcluster M7. Since FIG. 69 A was assigned an "A" for all 

indicated. As a result, a "U" is assigned to the feature in this three features (Fl, F2 and F3), it is assigned a "A" in 

case. It is important to note that the thresholds and tolerances subcluster M7 (zero "I"s, zero "U"s). FIG. 70 was assigned 
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a "IT for feature Fl, an "A" for feature F2 and a "IT for 
feature F3, resulting in a count of three (3) "U"s, zero "I"s 
and one "A". According to FIG. 67 (M7), this results in a 
score of "U" for subcluster M7 in the case of Solution B. 

Subclusters M8 and M9 must be processed, along with the 
features that feed into them, in a manner similar to M7, after 
which, the scores assigned to the three subclusters (M7, M8 
and M9) are combined in a matrix to produce a score for 
cluster M2. A process identical in nature to that described in 
the preceding discussion is executed at each cluster (M3, 
M4, M5 and M6) in the scoring tree/evaluation map. Finally 
the six scored clusters are combined, with appropriate 
weighting values, in the vignette's master matrix to produce 
a score (A, I or U) for the vignette. 

Fixtures Cluster (M7, M8 and M9). 

Both types of nodes, features and clusters scores, can take 
on three values: A, I, or U. In the case of the Fixtures cluster 
(see FIG. 67), which is composed of three lower-level 
features (Toilet, Lavatory and Bathtub), there are 27 (3x3x3) 
different possible "input" feature values; these are partially 
enumerated in Table 1 below. Each such outcome can be 
summarized by the counts of any two of the three possible 
values. The U's and Vs have been used as the summary of 
an outcome measure as seen in the last two columns of Table 
1. All possible values for a cluster can be represented by a 
two-dimensional matrix where the rows refer to the number 
of I's and the columns refer to the number of U's. 

TABLE 1 

Enumeration of Feature Values Corresponding to 
Toilet. Lavatory and Bathtub Clusters 



Feature 



Value 




Fixture Cluster 




Counts 


Sets 


Toilet 


Lavatory 


Bathtub 


U I 


1. 


A 


A 


A 


0 0 


2. 


I 


A 


A 


0 1 


3. 


A 


I 


A 


0 1 


4. 


A 


A 


I 


0 1 


5. 


I 


I 


A 


0 2 


6. 


I 


A 


I 


0 2 


7. 


A 


I 


I 


0 2 


8. 


I 




[ 


0 3 


9. 


U 


A 


A 


1 0 


10. 


A 


U 


A 


1 0 


11. 


I 


u 


[ 


2 2 


12. 


U 




[ 


1 2 


27. 


u 


u 


U 


3 0 



Table 2, below, is a possible matrix for the Fixture cluster. 
According to this matrix, an "A** corresponds to feature 
value set #1 with zero I 's and Zero U's (e.g. the feature value 
set #1 in Table 1). An "I" corresponds to feature value set 
number with one I and zero U's (e.g., feature sets #2, #3, and 
#4 in Table 1.) All other feature value sets get assigned a U. 
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TABLE 2 
Summary Matrix for Fixture Ouster 



0 1 2 



10 



0 


A 


u 


u 


1% 1 


I 


u 


u 


2 


U 


u 


u 


3 


U 


u 


u 



Although preferred embodiments of the present invention 
have been described above in detail, it is desired to empha- 
size that this has been for the purpose of illustrating and 
describing the invention, and should not be considered as 
necessarily limiting the invention, it being understood that 
many modifications can be made by those skilled in the art 
20 while still practicing the invention claim herein. 

SOFTWARE FILE STRUCTURE 

jnl3 files. 

Contain the reference information for the particular 
25 vignette. The files comprise the text and graphics for those 
portion of the index screen (see, for example, FIG. INDEX 
SCREEN), which include the following task information 
topics: "Vignette Directions"; "Program"; "Tips"; and 
"Review of the General Test Directions". These files are 
30 referenced by the corresponding .aut file. 

Several vignette specific references are included in one 
preferred embodiment of the present invention as well. 
These include lighting diagrams, building elevations, build- 
ing sections and tree diagrams. 
35 -aut files. 

Reference the files required by the corresponding delivery 
and scoring programs, and contain all non-graphical infor- 
mation required by delivery and scoring. For example, they 
contain specific feature values and criterion used by scoring. 
40 -dwg files. 

AutoCAD objects such as the following, which appear in 
one preferred embodiment of the present invention, namely: 
the lavatory, shower, bidet, water closet, etc. The drawings 
provide all graphical information required by the delivery 
45 and scoring programs, 
.mtx files. 

Matrix files provide tuples and weights required to allow 
scoring programs to translate feature scores into an overall 
score for the vignette. They contain information on the 
50 weights of features and which features feed into which 
matrixes and which squares of matrix are possible and what 
the cut-offs are. 
.dll files. 

Dynamic link libraries provide by third party software 
55 vendors (Borland, AutoCAD) and written internally that 
contain core functionality required by all delivery and 
scoring programs, 
.log files. 

Contain the candidates' "scores". They also contain ver- 
60 bose information about conditions encountered while scor- 
ing a particular solution that allow for validation that the 
scoring program is working correctly. 

REFERENCES 

65 Bejar, I.J. "From Adaptive Testing to Automated Scoring 
of Architectural Simulations" in El Mancall & PG Bashook 
(Eds.), pp. 115-127: Assessing Clinical Reasoning: The 
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Oral Examination and Alternative Methods. Evanston, 111., 9. The computerized system of claim 1 wherein the 

American Board of Medical Specialties, 1995. delivery subsystem of the present invention interfaces with 

NCARB, "How Vignettes are Scored** (National Council a test administration system, 

of Architectural Registration Boards, Wash. D.C. October 10, The computerized system of claim 9 wherein the test 

1994). 5 administration system is Open System Architecture (OSA). 

Reid-Green, K. (1996a). "Insolation and Shadow." 11 ■ The computerized system of claim 1 wherein the 

Research Report (RR-96-18), Educational Testing Service, scoring subsystem comprises: 

Princeton, N.J. means for decomposing a test candidate's solution; and 

Reid-Green, K. (1996b). "A Computer Method for Veri- means for analyzing said solution. 

fication of Wheelchair Accessibility in an Office." Research i 0 12. The computerized system of claim 1 wherein the 

Memorandum (RM-96-1), Educational Testing Service, assessment comprises vignette test items directed to building 

Princeton, N.J. design pro blems. 

Reid-Green, K. (1996c). "An Algorithm for Calculating 13 computerized system of claim 12 wherein the test 

Setback Polygons." Educational Testing Service, Princeton, item comprises a site section vignette. 

15 14. The computerized system of claim 13 further com- 

Reid-Green, K. (1996d). "An Algorithm For Determining prismg an index 

If an Object Can Be Viewed From Another Object." Edu- 15 ^ compu tcrized system of claim 13 further com- 

We D data! 8 1C<i ' ^ P rfsin S an vi ^ ette directions screen. ^ 

.* a „ • , * c *i_ c * i . 16. The computerized system of claim 13 further com- 

1. A computerized system for the professional assessment . . 3 
e u-* . • -i ■ *• i * 20 prising an program screen. 

ot architects, civil engineers, aeronautical engineers, r *-^tt_ • * * • <- • 

, • i • „ i * * * * j * 17. The computerized system of claim 13 further com- 

mechamcal engineers, naval engineers, intenor designers, . . v J 

landscape designers, and architectural designers, by the ^ >n f m ^ T ? ^ scre ^ n, t 

t . . . 4 j-j * j ■ r 1». The computerized system of claim 13 further com- 

creation, presentation to a test candidate, and scoring of a . . *, 7 . 

test item in the form of a computer-based simulation of P^g a general test directions screen 

professional practice, wherein the system comprises: 25 . 19 ^ com P uten2ed s y stem of daun 12 whereln mc test 

' . ... item comprises a site analysis vignette, 

an authoring subsystem for creating a computer-based 20 ^ tcrizcd ' stcm 0 f claim u wherein me test 

simulation of professional practice test item; ^ a site &ading v ^ nette _ 
a delivery subsystem which assembles the test item for the 21 ^ computerized system of claim 20 further corn- 
iest candidate, presents the test item to the test 30 prising a vignette directions screen, 
candidate, provides computerized tools to the test can- 2 2. ^ computerized system of claim 20 farther com- 
didate for use m solvmg the test item, and stores the prising a program directions screen. 

solution; and 23 ^ com p U x GI ized system of claim 20 further com- 

a scoring subsystem which decomposes, analyzes and p rfsing a tips screen, 

scores the solution. 35 2 4. The computerized system of claim 20 further com- 

2. The computerized system of claim 1 wherein the prising a scoring decision tree. 

authoring subsystem comprises means for creating and 25. The computerized system of claim 20 further corn- 
establishing scoring rules and criteria for test items. prising features scoring. 

3. The computerized system of claim 2 wherein the 2 6. The computerized system of claim 25 further corn- 
authoring subsystem further comprises means for specifying 40 prising a scoring decision tree. 

the names and attributes of spaces that will comprise a 27. The computerized system of claim 25 further com- 

unique script. prising features scoring. 

4. The computerized system of claim 1 wherein the 28. The computerized system of claim 25 further corn- 
delivery subsystem comprises means for assembling a com- prising a master features matrix. 

plete test item for a test candidate based on instructions 45 29. The computerized system of claim 20 further corn- 
stored in an authoring file. prising a features matrix. 

5. The computerized system of claim 4 wherein said 30. The computerized system of claim 20 further corn- 
instructions direct the delivery subsystem: prising s i tc grading vignette solution source code. 

to reference various files stored in multiple formats and 31. The computerized system of claim 12 wherein the test 

locations; and 50 item comprises a zoning section vignette. 

how to present certain features, options, menus, and 32. The computerized system of claim 31 further corn- 
drawing elements to a test candidate. prising the feature matrices. 

6. The computerized system of claim 1 wherein the 33. The computerized system of claim 12 wherein the test 
authoring subsystem comprises FRAMEWORK software item comprises a site parking vignette. 

which has been compiled as a dynamic link library. 55 34. The computerized system of claim 12 wherein the test 

7. The computerized system of claim 6 wherein the item comprises a site design vignette. 

dynamic link library includes a library of computer code 35. The computerized system of claim 1 wherein the 

representing geometric objects. assessment comprises vignette test items directed to site 

8. The computerized system of claim 6 wherein the design problems. 

dynamic link library is comprised of the following kinds of 60 36. The computerized system of claim 35 wherein the test 

files: COMPONENT files; CONTROL files; DWG files; item comprises a schematic design vignette. 

EVENTS files; FEATURES files; GEOMETRY files; 37. The computerized system of claim 35 wherein the test 

GRAPHICS files; HDR files; MOUSETRK files; OBJS item comprises a schematic structural design vignette, 

files; OSA files; OSACALC files; PERSTGEO files; APPU- 38. The computerized system of claim 35 wherein the test 

CAT files; SCORING files; TRANSACT files; VGNOBJEC 65 item comprises a mechanical and electrical plan vignette, 

files; VGNTASKS files; VGNWIND files; and WINDOWS 39. The computerized system of claim 35 wherein the test 

files. item comprises a building section vignette. 
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40. The computerized system of claim 35 wherein the test 
item comprises a accessibility — ramp vignette. 

41. The computerized system of claim 35 wherein the test 
item comprises a accessibility — toilet room vignette. 

42. The computerized system of claim 41 further com- 5 
prising Sample Authoring File for Accessibility-Toilet 
Vignette source code. 

43. The computerized system of claim 35 wherein the test 
item comprises a stair design vignette. 

44. The computerized system of claim 35 wherein the test 10 
item comprises a roof plan vignette. 

45. The computerized system of claim 35 wherein the test 
item comprises an interior layout vignette. 

46. A computerized method for the assessment of archi- 15 
tects by the creation, presentation to a test taker, and scoring 
of a test item in the form of a computer-based simulation of 
architectural practice, comprising the steps of: 

authoring a test item in the form of a computer-based 

simulation of architectural practice using a dynamic 20 

link library comprising geometric objects; 
delivering the test item to a test taker and providing the 

test taker with the tools necessary to provide a response 

to the test item; and 
scoring the test taker's response by using a hierarchical 25 

organization of problem features needed to characterize 

performance and decomposing the test taker's 

response. 

47. The computerized method of claim 46 wherein the 
tools provided to the test taker are comprised of common 30 
and unique tools. 

48. The computerized method of claim 47 wherein the 
common tools farther comprise: SKETCH icon tools; 
ORTHO icon tool; ZOOM icon tool; CURSOR icon tool; 
UNDO icon tool; ERASE icon tool; ID icon tool; CALC 35 
icon tool; TASK INFO icon tool; START OVER icon tool; 
and a REVIEW icon tool. 

49. The computerized method of claim 47 wherein the 
unique tools further comprise: CHECK OVERLAPS icon 
tools; DRAW icon toot; MOVE ADJUST icon tool; MOVE 40 
GROUP icon tool; ROTATE icon tool; LAYERS icon tool; 
OPTIONS icon tool; and a SET ROOF icon tool. 

50. The computerized method of claim 47 wherein the 
step of scoring the test taker's response comprises: 
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feature extraction; and 
matrix calculation. 

51. The computerized method of claim 50 wherein feature 
extraction comprises: 

reading feature requirements from an authoring file; 

comparing the requirements against data in a test taker's 

solution file; and 
determining a score of Acceptable (A), Indetermined (I) 

or Unacceptable (U) for each feature. 

52. The computerized method of claim 50 wherein feature 
extraction comprises: 

reading feature requirements from an authoring file; 
comparing the requirements against data in a test taker's 

solution file; and 
detennining a score of Acceptable (A), Indeterminate (I), 

Unacceptable (U) or Fatal (F) for each feature. 

53. The computerized method of claim 50 wherein matrix 
calculation comprises: 

assigning each feature to a sub-matrix; 

assigning a weight to each feature in a sub-matrix; 

scoring the sub-matrix as either Acceptable (A), Indeter- 
minate (I) or Unacceptable (U); by associating a cut 
score with the matrix which determines how many 
scores of an appropriately weighted feature scores of 
either (I) or (U) the matrix can have before the matrix 
is to be scored as an (I) or (U); 

assigning, as applicable, each sub-matrix and its score to 
a sub-matrix or second sub-matrix which second matrix 
comprises feature scores and other sub-matrix scores; 

assigning a weight to each feature and sub-matrix in a 
matrix; 

scoring the matrix as either (A), (I) or (U) by associating 
a cut score with the matrix which determines how many 
scores of an appropriately weighted feature scores or 
sub-matrix scores of either (I) or (U) the matrix can 
have before the matrix is to be scored as an (I) or (U); 
and 

continuing the above steps until all features and sub- 
matrices have been scored and a final overall score 
determined. 

***** 
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ABSTRACT 



In an information recording medium on which video infor- 
mation can be recorded, control information 78 is stored in 
its data area 76. Following the control information 78, a 
video object 82 to be reproduced is stored. The control 
information 78 includes playback interrupt information 124 
for resuming playback during the interruption of playback. 
An area for the process is provided. This makes it possible 
to reproduce the picture next time where the playback was 
interrupted, referring to the playback interrupt information 
124. Consequently, even when the disk is removed from the 
video-recordable reproducing system, reinstalling the disk 
into the system makes it possible to play back the disk where 
the playback was interrupted. 

7 Claims, 18 Drawing Sheets 
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INFORMATION REPRODUCING SYSTEM, interrupted. This causes a problem: the user himself or 

INFORMATION RECORDING/ herself has to seek the location to be played back. A 

REPRODUCING SYSTEM, AND RECORDING playback-only DVD video player of the latest model uses an 

MEDIUM APPLICABLE TO THE SYSTEM EE-ROM as a memory for storing the playback end infor- 

5 mation and has the information disk by disk (for example, 

This is a continuation of Ser. No. 09/582,227 filed Aug. being capable of storing the playback end information for up 

14, 2000, now abandoned, which is a 371 of PCT/JP99/ to ten disks). Even when the disk is changed, the location to 

00211 filed Jan. 21, 1999. be played back can be searched for. 

However, there is a limit to the storage capacity of the 

TECHNICAL FIELD io memor y that uses the method of storing the playback end 

This invention relates to an information reproducing information. Thus, it is expected that unlimited replacement 

system, an information recording/reproducing system, and a of disks will make it impossible to search for the playback 

recording medium applicable to the system, and more par- location. 

ticularly to a reproducible playback DVD player, a The DVD player systems have the following problem: 

recording/playback DVD player, and an optical disk appli- 15 when the disk is removed, the playback end information on 

cable to these DVD players. the disk disappears, and therefore, the user has to seek the 

playback location, even when the same disk is inserted, to 

BACKGROUND ART resume playback where it was interrupted. 

In recent years, a system for playing back an optical disk 2Q DISCLOSURE OF INVENTION 
on which images (moving pictures), sound, and others have 

been recorded has been developed. LDS (laser disks) or An object of the present invention is to provide a disk 

video CDs (video compact discs) which enable the playback which enables the interruption of playback where it was 

of movie software, karaoke, and the like have been put on interrupted, provided that, after the disk was removed from 

the market and widely used. a playback system capable of recording, the disk is installed 

The DVD standard using the internationally standardized 25 a S ain in me s y sicm - 
MPEG-2 (Moving Image coding Experts Group) scheme as Another object of the present invention is to provide an 
a moving-picture compression scheme and the AC-3 audio information reproducing system capable of resuming play- 
compression scheme as an audio coding mode has been back where it was interrupted, provided that, after a disk was 
proposed. Optical disks complying with the standard 30 removed from a system capable of recording, the disk is 
(hereinafter, just referred to as DVD disks) are commercially installed again in the system. 

available and widely used. The DVD standard adopts a Still another object of the present invention is to provide 

moving-picture compression scheme conforming to the an information recording/reproducing system capable of 

MPEG-2 system layers, supports AC-3 audio or MPEG resuming playback where it was interrupted, provided that, 

audio as an audio coding mode, and has a data structure 35 after a disk was removed from a playback system capable of 

including not only a sub-picture pack in which sub-picture recording, the disk is installed again in the system, 

data obtained by run -length compressing the bit map data for The foregoing objects are accomplished by providing an 

subtitles has been stored independently but also a navigation information recording medium on which video information, 

pack in which special playback control data, such as fast- audio information, and others can be recorded, the informa- 

forward playback or fast-rewind playback data, has been tion recording medium characterized by including an area in 

stored independently in a similar manner. Furthermore, the which playback interrupt information for resuming playback 

DVD standard supports ISO 9660 and micro UDF to allow during the interruption of playback can be recorded, 

computers to read data. According to the invention, there is provided an informa- 

Presently, the DVD standard has been determined in the tion recording/reproducing system for reproducing video 

form of playback-only formats and therefore is not appli- 45 information and audio information from an information 

cable to home recording/reproducing optical disks and their recording medium on which video information, audio 

players. Thus, when recording/reproducing systems for information, and others can be recorded and which includes 

home use are constructed according to the DVD standard, it a recording area in which playback interrupt information for 

is clear that the following problems arise. A playback-only resuming playback during the interruption of playback can 

DVD video player generally has a resume playback function 50 be recorded, the information reproducing system character- 

of, after the interruption of playback, resuming the playback ized by comprising a specifying section for specifying the 

where it was interrupted. Specifically, in the resume play- resumption of playback and a playback interrupt reading 

back function, when the playback of the inserted disk has section for reading the playback interrupt information from 

been interrupted, information on the location (address) of the recording area according to the specification from the 

the place where playback was just in progress is stored in the 55 specifying section and in that the system resumes playback 

RAM in the player, information on the location is accessed, where playback was interrupted, according to the specifica- 

for example, the resume playback key is pressed, or the play tion from the specifying section. 

key is pressed once to read data on the location where Furthermore, according to the invention, there is provided 
playback was just in progress from the memory, and an information recording/reproducing system for reproduc- 
thereafter, the playback is resumed where it was interrupted, 60 ing video information and audio information from an infor- 
or the play key is pressed again to restart the normal mation recording medium on which video information, 
playback. audio information, and others can be recorded and which 
In the resume playback function in a presently popular- includes a recording area in which playback interrupt infor- 
ized playback-only DVD video player, when the disk is mation for resuming playback during the interruption of 
removed, the playback end information on the disk disap- 65 playback can be recorded, the information recording/ 
pears. Even if the same disk is inserted again, it is impossible reproducing system characterized by comprising a specify- 
to" resume playback where the playback of the disk was ing section for specifying the interruption of playback and a 
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recording section for recording the playback interrupt infer- BEST MODE FOR CARRYING OUT THE 

mation in the recording area according to the specification INVENTION 

from the specifying means. Hereinafter, referring to the accompanying drawings, a 

With the information recording/reproducing system of the digital information recording/reproducing system according 

present invention, since the playback interrupt information 5 to an embodiment of the present invention will be explained, 

has been written on the disk, even when the disk is removed A typical embodiment of the digital information 

from the system, reinstalling the disk into the system makes recording/reproducing system according to the present 

it possible to resume playback. invention is a system for recording and reproducing the 

moving pictures encoded on the basis of MPEG 2 at a 

BRIEF DESCRIPTION OF DRAWINGS 10 variable bit rate, such as a DVD video digital recorder. 

FIG. 1 is a perspective view to help explain the configu- F1G * J is a ^l^V^Vl ^l^t ™£°f^\ 

ration of an optical disk (DVD-RAM or DVD-RW) that ra *j on of a ^ordable optical disk used for the DVD digital 

enables recording and reproducing. V1 eo recor er ' 

™^>o -»aj^ j • *ui As shown m FIG. 1, the optical disk 10 is such that two 

FIGS. 2 A and 2B are diagrams to help explain the data t5 4 4 , t 4 ' *\ .. , ... 

. . , , /mm oAx^ fc ,o « 15 transparent substrates 14, each provided with a recording 

recording area on the optical disk (DVD-RAM) of FIG. 1 • . - . , ' , r % , ... . ~? 

, 6 . . . ^ r \. t i p +u a * layer 17, are laminated together with an adhesive layer 20. 

and a correlation between the recording tracks tor the data r J . L * > i A u a t nc *u i 

.... . . . % Each substrate 14 can be composed of 0.6-mm-tmck poly- 
recorded in the area and the data recording area. . , „ . . ~ A u M . ' ( 

carbonate and the adhesive layer 20 can be composed ot 

FIG. 3 is a diagram to help explain the directory structure yery thin (fof examplej 40^m-thick) ultraviolet-curing 

of the information recorded on the optical disk of FIGS. 1 20 resin ^ o.6-mm-thick substrates 14 are laminated 

anc * 2. together in such a manner that the recording layers 17 come 

FIG. 4 shows the data structure of the video object set into contact with the surfaces of the adhesive 20, thereby 

shown in FIG. 3. forming a 1.2-mm-thick large-capacity optical disk 10. 

FIG. 5 shows the structure of a data pack shown in FIG. In the optical disk 10, a central hole 22 is made. Around 

4. 25 the central hole 22 on both sides of the disk, there are 

FIG. 6 shows the data structure of the control information provided clamp areas 24 for clamping the optical disk 10 

shown in FIG. 4. when it is being rotated. When the optical disk 10 is loaded 

FIG. 7 shows "the contents of the playback management ™ to a dis "rive unit (not shown), the spindleof a dtt motor 

table (PLY_MAT) shown in FIG. 6. 30 I s "f= rtedin *? central hole 22 - ™ 6n ' th * ?P^ cal disk , ™ 

is clamped at the clamp areas 24 by a disk damper (not 

shown), while it is being rotated. 

The optical disk 10 has an information area 25 on which 

FIG. 9 shows the contents of the playback interrupt video dat3j audk) data> and other information can be 

information table shown in FIG. 6. recorded, around the clamp area 24. In the information area 

FIGS. 10A, 10B, 10C, and 10D are diagrams to help 3 25, a lead-out area 26 is provided on its outermost side and 

explain the concept of the PGC shown in FIG. 8. a lead-in area 27 is provided on its innermost side in contact 

FIG. 11 shows the contents of the PGC information with the clamp area 24. Between the lead-out area 26 and the 

management information shown in FIG. 8. lead-in area 27, a data recording area 28 is defined. 

FIG. 12 shows the contents of the PGC general informa- 40 On the recording layer (light reflecting layer) 17 in the 

tion shown in FIG. 8. information area 25, a recording track is formed continu- 

FIG. 13 shows the contents of the cell playback informa- °usly in, for example, a spiral. The continues track is divided 

tion shown in FIG 8 ult0 P n y s ^ ca l sectors. These sectors are numbered serially. 

FIG. 14 shows the contents of the recording management Usingme sectors ^ units of r^ordmg, various types of data 

table shown in FIG. 6. 4S are recorded on the optical disk 10. 

FIG. 15 is a block diagram to help explain the configu- ne . ^ta icconHag area 2* is an actual data recording 

ration of a system (DVD video recorder) that records and area >. m w ^ lch vlde ° data < maln P^ e data )' such 

, j. i » . . • r • *u movies, sub-picture data, such as subtitles or menus, and 

reproduces digital moving-picture information using the * * , ' , «• * i_ i_ 

. £ . . ° r * * j ■ i + audio data, such as lines or sound effects, have been 

lniormaUonwim me stmcrures explained mrlub. 2 to 14 on ' ... , . . « _ 

the disk of FIG 1 50 recorc * et * ^ recording/reproducing information in the torm 

n " * , . . , . , of bit trains (which are a physical form or phase change state 

FIG. 16 is a flowchart showing a normal playback opera- ^ Qmges ^ reflected laser ^ tQ change optically) . 

tion m the DVD video recorder shown in FIG. 15. „„ .. . , in . n AXjf , r , 

. t . When the optical disk 10 is a RAM disk for recording/ 

FIG. 17 is a flowchart showing the process of playing reproducing, the recording layer 17 can be composed of a 
back cells during a normal playback operation in the DVD ^ ^ layer formed by sandwiching a phase chaoge record- 
video recorder shown in FIG. 15. ^ material layer (for eX ample, Ge 2 Sb 2 Te 5 ) between two 

FIG. 18 is a flowchart showing a resume playback opera- z i nc sulfide .silicon oxide mixtures (ZnS.SiO^. 

tion in the DVD video recorder shown in FIG. 15. Io the re ad-only DVD-ROM disk 10, pit trains are formed 

FIG. 19 is a flowchart showing the process of displaying ' m the substrate with a stamper beforehand. On the surface 

the playback remaining time using the playback interrupt 60 0 f me substrate 14 in which the pit trains have been formed, 

information shown in FIG. 9. a reflecting layer made from, for example, metal, is formed. 

FIG. 20 is a hierarchical diagram showing a modification The reflecting layer is used as the recording layer 17. In such 

of the embodiment of the format shown in FIG. 3. a DVD-ROM disk 10, grooves acting as recording tracks are 

FIG. 21 is a table showing the contents of the description generally not made and the pit trains made at the surface of 

of the resume marker information written in the video 65 the substrate 14 function as tracks. 

management information management table shown in FIG. In each of the various types of optical disk 10, playback- 

20. only ROM information is recorded in the recording infor- 
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mation area of the recording layer 17 in the form of an where information can be rewritten. The lead-out area 26 is 

emboss signal. In contrast, such an emboss signal has not composed of a rewritable zone that enables information to 

been etched in the recording information area of the sub- be rewritten. 

strate 14 having the recording layer 17 for recording and i n the emboss data zone of the lead-in area 27, informa- 

reproducing and instead a continuous groove has been 5 tion about the whole information storage medium, including 

etched. A phase change recording layer has been provided in me type of disk, such as DVD-ROM (read-only DVD disk), 

the groove. In the case of a recording/reproducing DVD- DVD-RAM (recording/reproducing DVD disk), or DVD-R 

RAM disk, not only the groove but also the phase change (postscript-type DVD disk), the disk size, the recording 

recording layer of the land portion is also used for informa- density, and the physical sector numbers indicating the 

tion recording. 10 recording start/recording end positions, has been recorded. 

The DVD digital video recorder is designed to be capable In addition, information about the recording, reproducing, 

of the repetitive recording and playback (reading and and erasing characteristics, including the recording power 

writing) of a DVD-RAM disk (or DVD-RW disk) and of the and recording pulse width needed to record the data in the 

repetitive playback of a DVD-ROM disk. recording layer 17, the recording power needed to erase the 

FIGS. 2A and 2B are diagrams to help explain the data 15 data recorded in the recording layer 17, the reproducing 

recording area 28 on the optical disk (DVD-RAM) 10 of power needed to reproduce the data recorded in the record- 

FIG. 1 and a correlation between the recording tracks for the ing layer 17, and the linear velocity during recording and 

data recorded in the area and the data recording area. erasing, has been recorded. Furthermore, in the emboss data 

.u a- t in- twt^ r> a** / t^\^i t5\ia tu a zone of the lead-in area 27, information on the manufacture 

When the disk 10 is a DVD-RAM (or DVD-RW), the „ ' . . , . . _ 

LJ c i in • l j- . -J 11 * * ♦ »u 20 of each information storage medium, including the serial 

body of disk 10 is housed in a cartridge 11 to protect the t , L , ,% , _ . . ,f , t 

c jU mm n a*/ i in number, has been recorded, hacn ot the rewritable data zone 

delicate disk surfaces. After the DVD-RAM disk 10, ~- ■ , j • j ^ li j . r tL 

.i_ -.t. a * j 11 • • * j * * 4U j- 1 j • 27 of the lead-in area and the rewritable data zone or the 

together with the cartridge 11, is inserted into the disk dnve , . . . ,. r ,. 

r iL mm j ~i i • j * i» ,1*1 in* lead-out area includes a recording area tor recording a 

of the DVD video recorder, explained layer, the disk 10 in . ... r ,. r * , to 

iL „ . , c 4 , - ,t unique disk name for each information storage medium, a 

the cartridge 11 is clamped to the turn table of the spindle M . . f . * ' 

j . r , (tL ,., f ' u 25 checking trial recording area for checking whether recording 

motor and is rotated m such a manner that the disk races the & . , , to , 4U to . 

o tical head (not shown) a erasm S can done under the recording and erasing 

" ^ *' conditions, and a management information recording area 

On the other hand, when the disk 10 is a DVD-R or fof the presence or absence of a faulty ^ m the data m3L 

DVD-ROM, the body of the disk 10 is not housed in a ?2 and the address of lhe area A prepara tory process for 

cartridge 11, the naked disk 10 is set directly on the disk tray 30 enabling data t0 be recorded in the data area 72 is carried out 

of the disk drive. * m m j s area ^ and tbe information necessary for subsequent 

At the recording layer 17 in the information area 25 data recording, erasing, and reproducing is recorded, 

shown in FIG. 1, the data recording track has been formed The vohime gpace 2g fe diyided physically into a large 

continuously in a spiral. As shown in FIG. 2B, the continues number of &ectors physical ^ m assigned 

track is divided into logical sectors (minimum recording 35 consecutive number s. The logical addresses for the data 

units) with a specific storage capacity. Data is recorded in recorded in me vo i ume space (data recording area) 28 mean 

logical sectors. The storage capacity of one logical sector is , Q ical sect0f numbeis ^ determined in ISO 9660 and UDF 

set to 2048 bytes (or 2 kilobytes), the same as one pack data bridgc ^ gize of the logical k sct tQ bytes (2 

* en S tn * kilobytes) as the valid data size of the physical sector. 

The data recording area 28 is an actual data recording 40 ^ ]q ^ q ^ numbers are allocated consecutive 

area, in which management data, main picture (video) data, numbers in ascending order of the physical sector numbers, 

sub-picture data, and sound (audio) data have been recorded ^ vohime ^ 2g faa& a hierarchical structure and 

similarly. includes a volume/file management area 70 and a data area 

FIG. 3 shows the hierarchical structure of the data ^ 72 composed of one or more video objects. These areas 70 

recorded on the optical disk 10 acting as an information and 72 separated on the boundary between logical 

storage medium that enables the recording and reproducing sectors. One logical sector is defined as containing 2048 

of the image information and music information shown in bytes Q ne i og i ca i b i oc k [ s ^so defined as containing 2048 

FIGS. 1 and 2. bytes. Therefore, one logical sector is defined as being 

The data recording area 28 formed on the optical disk 10 5Q identical with one logical block, 

shown in FIGS. 1 and 2 has the hierarchical structure of data jhe volume/file management area 70 is a rewritable data 

as shown in FIG. 3. The logical format of the structure is zone ^ wb i cb me user caa rec0 rd and rewrite data and 

determined so as to comply with ISO 9660, one of the corresponds to a management area determined in ISO 9660 

international standards, and with the universal disk format and tjdf bridge. On the basis of the description in the area 

(UDF) bridge. S5 70, information about the whole file or volume of audio/ 

As shown in FIG. 3, the lead-in area 27 is provided on the video data is stored in the system memory (not shown) in a 

inner circumference side of the optical disk 10 and the DVD video recorder explained later. In general, the volume/ 

lead-out area 26 is provided on the outer circumference side file management area 70 is composed of one file, 

of the optical disk 26. The data recording area 28 between j^q da ta area 72 is designed to enable computer data and 

the lead-in area 27 and the lead-out area 26 is assigned as a 60 aud i 0 da t a to be recorded in a mixed manner as shown in 

volume space. The volume space 28 includes a space FIG. 3. The order in which computer data and audio and 

(volume/file management area 70) for information on the video data are recorded and the size of each recording 

volume and file structure and a space (DVD data area 71) for information are arbitrary. Areas in which computer data has 

applications conforming to the DVD standard. been recorded are referred to as computer data areas 74-1, 

The lead-in area 27 includes a read-only emboss zone 65 74-2. An area in which audio and video data has been 

where the optical reflecting surface is uneven, a mirror zone recorded is referred to as an audio and video data area 76. 

where the surface is a flat mirror, and a rewritable data zone When only audio and video data is recorded in the recording 
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area 72, the computer data areas 74-1, 74-2 are not neces- may be composed of only audio data. In this case, as with the 

sarily provided because of their nature. Similarly, when only video object VOB including video data, the audio packs 90 

computer data is recorded in the recording area 72, the audio to be reproduced during the playback time of the video 

and video data area 76 is not necessarily provided because object unit (VOBU) 85 to which the audio data belongs are 

of its nature. Each of the computer data areas 74-1, 74-2, and 5 stored in the video object unit (VOBU) 96. 

audio and video data area 76 is composed of one or more ^ videQ objects $2 ^ 86 ^^^g me video ^ }GCi 

. , . , mr c . set 80 are assigned identification numbers (IND#i; i=0 to i). 

In the audio and video data area 76 control information The identification num bers enable the video objects 82, 84, 

78 necessary to carry out each of the video recording (audio g6 tQ ^ idemified ^ the video objects 82j 84 86? each 

recording) reproducing, editing and retrieving processes 10 ^ ^ fa ^ d an identification number (QJDN#j). 

and the object to be reproduced, or a video object set 80 D 

composed of one or more video objects 82, 84, and 86 as F1G 5 shows » J"*™* stmcmre of the video pack 88 
contents, are recorded as shown in FIG. 3. The video object sub-picture pack 92, and audio pack 90. Like the logical 
80 includes a video object 80 whose content is video data, sector of FIG - 2 > each of these P a ^ ^ ontains ^ b ^ s ° f 
a picture object 84 whose content is still pictures, such as - , data * Each of the Vlde0 > audl °> and ^-picture packs 88 90, 
still slides, the desired location in the video data, or picture 92 * composed of a pack header 98 and a packet 100 as 
data, such as retrieving or editing thumbnails, and an audio shown 111 ™ G *■ ™ e P a£ * et ™° mcludes a ^' h ^ 
object 86 whose content is audio data. Apparently, it is In the P acket . header > a ^ de u time L stam P QfJ> and a 
sufficient that the video object set 80 is composed of at least presentation time stamp (PTS) have been recorded, 
one of these objects 82, 84, 86. It is not necessary to prepare 20 The control information shown in FIG. 3 includes play- 
all the objects 82, 84, 86. Similarly, each of the objects 81, back control information 102 indicating control information 
84, 86 is composed of one or more files. necessary for playback, recording control information 104 
In the video object set 80 composed of one or more indicating control information necessary for recording 
objects 82, 84, 86, video data (video packs 88 explained ( video recording and audio recording), editing control infer- 
later) compressed according to the MPEG standard, audio 25 m atl0n 106 indicating control information necessary for 
data (audio packs 90 explained later) compressed according edilin S> and thumbnail picture control information 108 indi- 
te a specific standard or uncompressed, and run-length- catin S management information about searching or editing 
compressed sub-picture data (sub-picture packs 92 including thumbnails for locations in the video data the user wants to 
bit maps, explained later, where one pixel is defined by bits) watch. 

have been stored as shown in FIG. 4. Apparently, when the 30 The playback control information 102 shown in FIG. 3 

video object set 80 is composed of video objects 80, it has includes a management information table (PLY_MAI) 122, 

a data structure as shown in FIG. 4. When the video object a program chain (PGC) information table (PGC IT) 110, and 

set 80 is composed of picture objects 84, it has a data a playback interrupt information table (PLY_IIT) 124 as 

structure composed of only video packs 88 including no shown in FIG. 6. In the management information table 

audio pack 90 and/or sub-picture packs. In addition, when 35 (PLY„MAT) 122, the information as shown in FIG. 7 has 

the video object set 80 is composed of audio objects 86, it been written. The program chain (PGC) information table 

has a data structure composed of only audio packs 90 HO has a data structure as shown in FIG. 8. In the playback 

including neither a video pack 88 nor a sub-picture pack 92. interrupt information table 124, the information as shown in 

As shown in FIG. 4, the video object set 80, or the video, FIG. 9 has been written, 

picture, and audio objects 82, 84, 86 are logically composed 40 As shown in FIG. 8, the PGC information table 110 is 

of plural cells 94. Each cell 84 is composed of one or more composed of PGC information management information 

video object units (UOBUs) 96. In the cell 84, the video 112, search pointers #1 to #n 114 for searching for each piece 

object units (VOBUs) 96 are decoded and reproduced in the of PGC information, and pieces of PGC information #1 to #n 

order in which they are arranged in the cell 84, as a general 116. In the program chain (PGQ information table 110, 

rule. Each video object unit 85 is a set (pack train) of video 45 information about the order in which program chains 

packs (V packs) 88, sub-picture packs (SP packs) 92, and (PGCs) and cells are reproduced. The data in the cells 94 

audio packs (A packs) 90 and is defined as data to be recorded in the video object 82, that is, the movie data, the 

reproduced in a period of, for example, 05 to 1.2 secoods. actual data, composed of video object units 96, is repro- 

These packs are minimum units in performing data transfer. duced according to the description in the program chain 

The data is processed using logical cells as minimum units. 50 (PGC) information table 110. The program chain (PGC) 

The video object units (VOBUs) are assigned identification information table 110 is composed of PGC information 

numbers (IND#k; k=0 to k). The identification numbers management information 112, PGC information #1 to PGC 

enable the video object units 96 to be identified. The information #n, and search pointers 114 for searching for the 

playback period of the video object unit 96 generally cor- PGC information (#1) 116 for PGC information (#n) 116. 

responds to the playback time of the video data composed of 55 Once the number of PGC has been determined, the cell 

one or more picture groups (groups of pictures; abbreviated playback sequence to reproduce the PGC corresponding to 

as GOPs) included in a video object unit (VOBU) 85. One the number of the PGC is acquired by referring to the search 

GOP generally lasts for about 0.5 second in the MPEG pointer 114. According to the cell playback sequence, the 

standard and is converted into screen data compressed so as data in the cell 94 as real data is acquired from the video 

to reproduce about 15 frames of pictures in about 0.5 second. 60 object 82 and the video is played back. The video object 82 

When the video object unit VOBU 96 includes video data, has been explained until now. Similarly, the cell data as real 

GOPs (conforming to the MPEG standard) composed of data is taken out from the picture object 84 and audio object 

video packs 88, sub-picture packs 90, and audio packs 91 are 86 according to the description in the program chain (PGC) 

arranged, thereby forming a video data stream. Even when information table 110 and is reproduced, 

playback data is composed of only audio and/or sub-picture 65 The PGC corresponds to a chapter in a movie story and 

data, it is constructed using a video object unit (VOBU) 96 represents a unit for executing a series of playback where the 

as one unit. For example, the video object unit (VOBU) 85 cell playback sequence has been specified. In other words, 



04/28/2004, EAST Version: 1.4.1 



US 6,532334 Bl 

9 10 

when one PGC is likened to one drama, the cells 94 the presence of a user menu or such a menu does not exist, 

constituting the PGC can be interpreted as corresponding to a flag (00) indicating that there is no user menu is written, 

various scenes in the drama. The contents of the PGC (or the When a reduced picture has been recorded in the audio and 

contents of the cells) are determined by the software pro- video data area 76, the number of the PGC representing the 

vider that creates the contents recorded on the disk 10. 5 reduced picture and constituting the basis of the reduced 

Specifically, when there is a video data stream as shown in picture is written. In addition, a flag (0: unreproduced, 1: 

FIG. 10A, the contents are divided into video object units 96 reproduced) indicating whether or not the user has played 

to be reproduced in a certain period of time. A set of video back the video object set to be reproduced according to 

object units 96 consecutive in principle is defined as a cell reservation and control information 78 is written. 

94. 10 The PGC information management information (PGC__ 

Because the video object units 96 are consecutive in MAI) 112 shown in FIG. 8 includes information indicating 

principle, the cell 94 is defined by the first video object unit the number of PGCs as shown in FIG. 11. The PGC 

96 and last video object unit 96 constituting the cell in the information search pointer 114 includes information point- 

PGC information 116, more particularly, the cell playback ing at the head of each piece of PGC information as 

information 120, as explained later. Namely, in the cell 15 described earlier, making it easier to search for a PGC. The 

playback information 120, information on the playback PGC information 116 is composed of PGC general wfor- 

section specified by the start address and end address of the mation 118 shown in FIG. 7 and one or more pieces of cell 

playback data constituting the cell is written. playback information 120 shown in FIG. 8. 

Once the cells 94 have been determined, a PGC is Written in the PGC information management information 
constructed by determining the playback sequence of the 20 112 (PGC_MAI) as shown in FIG. 11 are the end address 
cells. For example, as shown in FIGS. 10B, 10C, and 10D, (PGC__TABLE„EA) of the PGC information table 110, the 
three cells 96 are arranged in a cell playback information end address (PGC__MAI_EA) of PGC information man- 
table in such a manner that cell-A, cell-B, and ceU-B are agement information 112 (PGC_MAI), the start address 
reproduced in that order, thereby defining PGC#1. Similarly, (PGC_SRP_SA) and end address (PGC__SRP__EA) of the 
three cells 96 are arranged in the cell playback information 2 s PGC information search pointer (PGC_SRP) 114, the start 
table in such a manner that cell-D, cell-E, and cell-F are addresses (PGCI_SA) and end addresses (PGCI_EA) of all 
reproduced in that order, thereby defining PGC#2. the pieces of PGC information (PGCI) 116, and the number 
Furthermore, five cells 96 are arranged in the cell playback of all the PGCs (PGC_Ns). 

information table in such a manner that cell-Q, cell-R, The PGC general information (PGC_GI) 118 includes 

cell-S, cell-T, and cell-U are reproduced in that order, 30 information indicating the playback time of PGC and the 

thereby defining PGC#3. Here, linking PGC#1 and PGC#2 number of cells as shown in FIG. 12. Specifically, written in 

together enables PGC#1 corresponding to a certain chapter the PGC general information (PGC_Gl) 118 are the number 

to be played back, followed by the playback of PGC#2 of the PGCs, the contents (PGC__CNT^ of the PGC describ- 

corrcsponding to the next chapter. In other words, cell-A to ing the number of cells, the playback time (PGC_PB_TM) 

cell-F are reproduced consecutively. In the PGC, the cells 94 35 of the PGCs, a table (PGC_AST_CTL) describing infor- 

are reproduced in the order of arrangement. Because the way mation to control the audio streams included in the PGCS, 

of constructing the PGC and the playback sequence of the and a table (PGC_SPST_CTL) describing information to 

PGC are arbitrary, for example, a PGC can be defined by the control the sub-picture streams included in the PGCs. 

cells constituting another PGC. In addition, the way of Furthermore, written in the PGC general information 

linking, or link information, can be determined arbitrarily, 40 (PGC_GI) 118 are link information about a PGC to be 

various stories can be created or edited. For example, linked with the PGC, for example, PGC navigation control 

PGC#3 can be linked, following PGC#1. Adding the same (PGC_NV_CTL) describing the preceding PGC, the fol- 

cell, for example, cell G, to PGC#1 and PGC#2 can create lowing PGC, or the (Goup) PGC at the jump destination, a 

a different chapter. The user can make a selection to link sub-picture pallet table (PGC__SP_PLT) describing repro- 

PGC#3 to PGC#1 or PGC#2, thereby reproducing any story. 45 duction information on the colors on the sub-picture pallet 

As shown in FIG. 7, in the playback management table and others, and the start address (PGC_PGMAP_SA) of a 

122, an identifier ID indicating playback control information program table (not shown) listing the programs constituting 

is written. In addition, the start address (VOBS_SA) and the PGC. In addition, written in the table (PGC_GI) are the 

end address (VOBS_EA) of the video object set 80 are start address of cell playback information (CELL_PLY_I) 
written. Moreover, the end address (CTLI_EA) of control so 120, a flag (01: menu data present, 00: menu data absent) 

information (CTL1) 102 and the end address (PLYI_EA) of indicating whether or not the user-created menu data on the 

the playback control information (PLYI) 102 are written. PGCs is present, reservation, a flag (0: unreproduced, 1: 

Furthermore, in the playback management table 122, an reproduced) indicating whether the user has reproduced the 

attribute (CAT) indicating that the management information PGCS, and a flag (ARCHIVE Flag) indicating whether or 
belongs to a recording/reproducing DVD format is written. 55 not the user wants to continue storing the PGCs, or a flag (0: 

In addition, the attribute of the video in the video object set free [erasable], 1: permanent storage) indicating that the user 

recorded in the audio and video data area 76, such as, the wants to store the PGCs forever. 

NTSC system or wide, is written. Moreover, the number In the cell playback information (CELL_PLY_I) 120 

(ATS_Ns) of audio streams in the similarly recorded video shown in FIG. 8, the category of a cell (C__CAT), for 
object set and a table (AST_ATR) describing its attribute, 60 example, whether the cell belongs to a block, and if it 

for example, the compression scheme, are written. belongs to the block, whether the block is an angle block, is 

Furthermore, the number (SPST_JSTs) of sub-picture streams written as shown in FIG. 13. Furthermore, in the ceil 

in the similarly recorded video object set and a table playback information (CELX_PLY_I) 120, the playback 

(SPST_ATR) describing its attribute and others are written. time (absolute time) of the cells in the PGC, a flag (0: 
When the user has recorded menu picture data and moving- 65 unreproduced, 1: reproduced) indicating whether the user 

picture or still-picture data in the form of independent files has reproduced the cell, and a flag (ARCHIVE Flag) indi- 

in the audio and video data area 76, if a flag (01) indicating eating whether or not the user wants to continue storing the 
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cell, or a flag (0: free [erasable], 1: permanent storage) 
indicating that the user wants to store the cell forever. 
Moreover, in the cell playback information (CELL_PLY_I) 
120, the start address (CELL__SA) and end address 
(CELL_EA) of the cell and the addresses of the first and last 
video object units (VOBUs) in the cell are written using 
relative addresses counted from the beginning of the video 
object set 80. 

The angle block means a block that enables the angle to 
be switched. Angle switching means changing the angle 
(camera angle) at which the picture of the subject is viewed. 
In an example of rock concert video, it means that the user 
can watch scenes taken at various angles, including a scene 
focusing on the vocalist, a scene focusing on the guitarist, 
and a scene focusing on the drummer. 

The cases where angle switching (or angle changing) is 
done include a case where angle can be selected according 
to the liking of the viewer and a case where the same scene 
is repeated automatically in the flow of the story, while the 
angle is being changed (a case where the software creator/ 
provider has composed the story that way or a case where 
the user of the DVD video recorder has edited the story that 
way). 

The playback interrupt information table 124 of FIG. 6 is 
a table in which the playback interrupt information to be 
written when the user interrupts the playback is written. As 
shown in FIG. 9, in the table 124, all of or part of the 
following items are written at the time of the interruption of 
the playback: the title number of the title whose playback 
has been interrupted, the part-of-title number at which the 
playback has been interrupted, the PGC number at which the 
playback has been interrupted, the program number in the 
PGC whose playback has been interrupted, the cell ID 
whose playback has been interrupted, and the ID of the 
video object unit whose playback has been interrupted. The 
title corresponds to a concrete title composed of video 
objects. The video objects are managed on a title basis. 
When the user subdivides a title and specifies part of the 
title, a part-of-title number is assigned and the number is 
recorded as interrupt information. When the user is a music 
fan, he or she can record a program for a singer and specify 
a scene of a special song in the program as part of title. 
Information on the scene is recorded as interrupt informa- 
tion. Furthermore, when the playback picture is a still 
picture, the time the still picture lasts and the remaining time 
of the still picture during the interruption of the playback are 
written. In addition, the elapsed time in reproducing a cell is 
written as interrupt information. Moreover, the time during 
the interruption of the playback and the recording time when 
the reproduced object is recorded are recorded. Still 
furthermore, time search time information to determine the 
time of interruption in the video object set (VOBS) or video 
object (VOB) temporally, a presentation time stamp repre- 
senting the time at which the interrupted video object unit 
(VOBU) 96 is presented, and the address at which the 
playback was interrupted, for example, the video object unit 
(VOBU) 96 or the physical sector address on the optical disk 
at which the playback was interrupted, and others are 
written. In addition, recorded in the playback interrupt 
information table 124 are whether or not the audio stream 
number and sub-picture stream at the time of interruption 
have been selected (whether or not the sub-picture should be 
displayed) and the sub-picture stream number at the time of 
the interruption when the sub-picture stream has been 
selected and the sub-picture has been displayed. Moreover, 
if necessary, predetermined general parameters (GPRM 0 to 
GPRM 15) are written. 
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The general parameters (GPRM 0 to GPRM 15) cause the 
details of the operation the user has carried out to be stored 
in memory and change the operation of the player on the 
basis of the details. The contents written as interrupt infor- 

5 mation in the playback interrupt information table 124 may 
include not only the items shown in FIG. 9 but also 
additional items, as the need arises. Moreover, among the 
items shown in FIG. 9, the necessary minimum items may 
be recorded. While the playback interrupt information table 
124 have been provided as an independent file at the same 
level of hierarchy as that of the playback management table 
122 as shown in FIG. 6, it may be provided in the playback 
management table 122. Alternatively, it may be provided at 
a higher level of hierarchy than that of the playback man- 
agement table 122. For instance, it may be provided at the 

15 same level of hierarchy as that of the playback control 
information 102 or that of the control information 78. 

The recording control information 104 of FIG. 6 includes 
a recording management table 126 shown in FIG. 14. In the 
recording management table 126, the end address (RECI_ 

20 EA) of the recording control information 104 and the end 
address (REC__MAT_EA) of the recording management 
table 126 are written. An empty area (FREE_SPACE) in 
which information on recording management is to be written 
is provided in the recording management table 126. 

25 Furthermore, in the recording management table 126, a flag 
(ARCHIVE Flag) indicating whether or not the user wants 
to store all the VOBS, or a flag (0: free [erasable], 1: 
permanent storage) indicating that the user wants to store all 
the VOBS forever. 

30 FIG. 15 shows an example of the configuration of a 
system (DVD video recorder) which records and reproduces 
the digital moving -picture information on and from the disk 
of FIG. 1 at a variable recording rate using the pieces of 
information having the structures explained in FIGS. 3 to 14. 

35 The body of the DVD video recorder shown in FIG. 14 is 
roughly composed of a disk drive section (32, 34, and 
others) that rotates a DVD-RAM or DVD-R disk 10 and 
reads and writes information from and on the disk 10, an 
encoder section 50 constituting the video recording side, a 

40 decoder section 60 constituting the playback side, and a 
microcomputer block 30 for controlling the operation of the 
body of the system. 

The encoder section 50 includes an ADC (analog/digital 

45 converter) 52, a video encoder (V encoder) 53, an audio 
encoder (A encoder) 54, a sub-picture encoder (SP encoder) 
55, a formatter 56, and a buffer memory 57. 

The external analog video signal+external analog audio 
signal from an AV input section 42 or the analog TV 

50 signal+analog audio signal from a TV tuner 44 are inputted 
to the ADC 52. The ADC 52 digitizes the inputted analog 
video signal at, for example, a sampling frequency of 13.5 
megahertz, with the number of quantization bits being eight 
bits. (That is, each of the luminance component Y, color 

55 difference component Cr (or Y-R), and color difference 
component Cb (or Y-B) is quantized in eight bits.) 

Similarly, the ADC 52 digitizes the inputted analog audio 
signal at, for example, a sampling frequency of 48 kilohertz, 
with the number of quantization bits being 16 bits. 

60 When the analog video signal and digital audio signal are 
inputted to the ADC 52, the ADC 52 allows the digital audio 
signal to pass through. (Only jitters incidental to the digital 
signal may be reduced or the sampling rate or the number of 
quantization bits may be changed without changing the 

65 contents of the digital audio signal.) 

On the other hand, when the digital video signal and 
digital audio signal are inputted to the ADC 52, the ADC 52 
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allows the digital video signal and digital audio signal to (C_PLY_J) as shown in FIG. 13 is created. Next, the 

pass through. (As for these digital signals, too, the jitter structure of a cell constituting a program chain (PGC) and 

reducing process, the sampling rate changing process, and the attributes of main picture, sub-picture, and audio, and 

others may be carried out without changing the contents of others are set (pieces of information obtained in encoding 

the digital signal.) 5 each data item are used as part of the attribute information), 

The digital video signal component from the ADC 52 is thereby creating the playback control information 102 

sent to the formatter 56 via the video encoder (V encoder) including various types of information explained in FIGS. 3 

53. The digital audio signal component from the ADC 52 is and 6. 

sent to the formatter 56 via the audio encoder (A encoder) The encoded main picture data, audio data, and sub- 

54. picture data are subdivided into packs of a specific size 
The V encoder 53 has the function of converting the (2048 bytes) as shown in FIG. 5. In these packs, time 

inputted digital video signal into a digital signal compressed stamps, including PTS (presentation time stamps) and DTS 

at a variable bit rate on the basis of the MPEG-2 or MPEG-1 (decode time stamps), are written. As PTS for sub-pictures, 

standard. me time obtained by arbitrarily delaying the PTS for the 

The A encoder 56 has the function of converting the 1$ main picture data or audio data in the same playback time 

inputted digital audio signal into a digital signal (or a linear zone may be wntten. 

PCM digital signal) compressed at a fixed bit rate on the Then, the packs are arranged into VOBUs 96, the data to 

basis of the MPEG or AC-3 standard. be reproduced in a certain period of time, in such a manner 

When the DVD video signal having a data structure as that they can be reproduced in the order of the time codes of 

shown in FIGS. 4 and 5 (for example, the signal from the the respective data. The VOBUs 96 are arranged, thereby 

DVD video player with an independent output terminal for 20 defining each data cell. Then, cells constitute a VOB. A 

sub-picture signal) is inputted from the AV input section 42, VOBS 80 composed of one or more VOBs is formatted into 

or when the DVD video signal having such a data structure the structure of FIG. 4. 

is broadcast and received by the TV tuner 44, the sub-picture The disk drive section for reading and writing (video- 
signal component (sub-picture pack) in the DVD video recording and/or reproducing) information from and on the 
signal is inputted to the sub-picture encoder (SP encoder) 55. 25 DVD disk 10 includes a disk changer section 110, a disk 
The sub-picture data inputted to the SP encoder 55 is drive 32, a temporary storage section 34, a data processor 
arranged into a specific signal form. The resulting data is 36, and a system time counter (or system time clock STC) 
sent to the formatter 56. 38. 

The formatter 56 performs specific signal processes on the 3Q The temporary storage section 34 is used to buffer a 

inputted video signal, audio signal, sub-picture signal, and certain amount of the data (the data outputted from the 

others, while using the buffer memory 57 as a work area, and encoder section 50) written onto the disk 10 via the disk 

outputs to the data processor 36 the recording data that drive 32 or a certain amount of the data (the data inputted to 

coincides with the format (file structure) as explained in the decoder section 60) reproduced from the disk 10 via the 

FIGS. 3 to 25. 35 disk drive 32. 

Here, the contents of a standard encoding process for For example, when the temporary storage section 34 is 

creating the recording data will be explained briefly. When composed of 4-megabyte semiconductor memory (DRAM), 

the encode section 50 of FIG. 15 starts the encoding process, it is possible to buffer about eight seconds of recording or 

the parameters necessary to encode the video (main picture) playback data at an average recording rate of 4 mbps. In 

data and video data are set. Next, using the set parameters, 40 addition, when the temporary storage section 34 is com- 

the main picture data is preencoded and the distribution of posed of a 16-megabyte EEPROM (flash memory), it is 

the optimum amount of codes for the set average transfer possible to buffer about 30 seconds of recording or playback 

rate (recording rate) is calculated. On the basis of the amount data at an average recording rate of 4 mbps. Furthermore, 

of codes obtained in the preencoding, the main picture is when the temporary storage settion 34 is composed of a 

encoded. At this time, the audio data is encoded at the same 4S 100-megabyte ultraminiature HDD (hard disk), it is possible 

time. to buffer longer than three minutes of recording or playback 

In a case where the amount of data compression is data at an average recording rate of 4 mbps. 
insufficient as a result of pre-encoding (a case where the When the disk 10 has run short in the course of video- 
desired video program cannot fit to a DVD-RAM disk or recording, the temporary storage section 34 can be used to 
DVD-R disk on which the user is going to record the 50 store the video-recording information until the disk 10 has 
program), if there is a chance to do pre -encoding (for been replaced with a new one. 

example, if the video recording source is a repeatedly Furthermore, when a high-speed drive (double-speed or 

reproducible source, such as a videotape or a video disk), faster one) is used as the disk drive 32, the temporary storage 

part of the main picture data is encoded again and the main section 34 can be used to store the extra data read from an 

picture data in the reencoded part is replaced with the 5S ordinary drive in a specific period of time. Buffering the read 

pre-encoded main picture part. By such a series of processes, data during playback in the temporary storage section 34 

the main picture data and audio data are encoded, thereby prevents the playback image from being interrupted, even 

remarkably reducing the value of the average bit rate nec- when the optical pickup (not shown) has made reading 

essary for recording. errors due to vibrations or shocks, because the playback data 

Similarly, the parameter necessary to encode the sub- 60 buffered in the temporary storage section 34 is used instead, 

picture data is set and the encoded sub-picture data is Under the control of the microcomputer block 30, the data 

created. processor 34 of FIG. 14 supplies the DVD recording data 

The encoded main picture data, audio data, and sub- from the encoder section 50 to the disk drive 32, takes out 

picture data are combined so as to have the structure of the the DVD playback signal reproduced from the disk 10 from 

video object. 65 the drive 32, rewrites the management information recorded 

Specifically, a cell is set as the minimum unit of the main on the disk 10, and deletes the data (files or VTS) recorded 

picture data (video data) and cell playback information on the disk 10. 



04/28/2004, EAST Version: 1.4.1 



US 6,532,334 Bl 



15 



16 



20 



The microcomputer block 30 includes an MPU (or CPU), 
a ROM in which control programs and others have been 
written, and a RAM that offers a work area necessary to 
execute programs. 

The MPU of the microcomputer block 30 uses the RAM 5 
as a work area according to the control programs stored in 
the ROM and functions as if it had a playback end infor- 
mation setting section 30A for determining playback end 
information, a playback end information takeout section 
30B for taking out playback end information, a playback io 
information resume specifying section 30C for giving an 
instruction to resume playback using the playback 
information, and a playback resume position deciding sec- 
tion 30D for determining the position at which playback is 
resumed. 15 

Of the results of the execution of the MPU 30, the 
contents to be reported to the user of the DVD video 
recorder are displayed on the display section 48 of the DVD 
video recorder and or on the on-screen display (OSD) of the 
monitor display. 

The timing with which the MPU 30 controls the disk 
changer section 100, disk drive 32, data processor 36, 
encoder section 50 and/or decoder 60 can be executed on the 
basis of the time data from the STC 38 (the operation of 
video-recording and reproducing is generally executed in 
synchronization with the time clock from the STC 38. The 
other processes may be executed with the timing indepen- 
dent from the STC 38). 

The decoder section 60 includes a separator 62 for sepa- 3Q 
rating and taking out each pack from the DVD playback data 
having a pack structure as shown in FIG. 5, a memory 63 
used in executing pack separation and other signal 
processes, a video decoder (V decoder) 64 for decoding the 
main picture data separated by the separator 62, a sub- 35 
picture decoder (SP decoder) 65 for decoding the sub-picture 
data (the contents of the sup-picture pack 90) separated by 
the separator 62, an audio decoder (A decoder) 68 for 
decoding the audio data (the contents of the audio pack 91 
of FIG. 9) separated by the separator 62, a video processor 4Q 
66 for combining the video data from the V decoder 74 with 
the sub -picture data from the SP decoder 65 suitably and 
superposing sub -pictures, including a menu, highlight 
buttons, and subtitles, on the main picture, a video digital/ 
analog converter (V.VAC) 67 for converting the digital video 45 
output from the video processor 66 into an analog video 
signal, and an audio digital/analog converter (A.DAC) 67 
for converting the digital audio output from the A decoder 68 
into an analog audio signal. 

The analog video signal from the V.DAC 67 and the 50 
analog audio signal from the A.DAC 67 are supplied via the 
AV output section 46 to an external component (not shown) 
(a multichannel stereo system with two to six channels* 
monitor TV or projector). 

The data processing operation, that is, the video-recording 55 
and reproducing processes, in the above recording/ 
reproducing system (DVD video recorder) will be 
explained. 

In data processing during video-recording, when the MPU 
section 30 receives a video-recording instruction as a result 60 
of the user's key input, the necessary management data is 
read from the DVD disk 10 from the disk drive section 32 
and an area to be written into is determined. Next, setting is 
done in the management area so that the recording data may 
be written in the determined area. The write start address for 65 
the video data is set in the drive section 32, thereby 
preparing to record the data. 



The management area that is set indicates a file manage- 
ment section (directory code in ISO 9660) and control 
information 78. The necessary parameters are recorded in 
the file management section. 

Next, the MPU 32 resets the time in the STC section 38. 
At this time, the STC section 38 effects video-recording and 
reproducing on the basis of the value in the timer of the 
system. Thereafter, the MPU section 30 implements setting 
in each of the other sections. 

The flow of the video signal is as follows. The AV signal 
supplied from the TV tuner section 44 or by an external input 
is A/D converted by the ADC 52. The picture signal is 
inputted to the video encode section 53, the audio signal is 
inputted to the audio encode section 54, and the TV tuner 
section 44 inputs a closed caption signal or a text signal in 
teletext or the like, to the SP encode section 55. 

Each decode section compresses each signal into packets 
(in such a manner that, when each packet is divided into 
packs, each pack contains 2048 bytes) and input them to the 
formatter 56. The respective decoder sections 53, 54, and 55 
decide and record the PTS and DTS of each packet accord- 
ing to the value in the STC section 38, as the need arises. 

The formatter section 56 stores the packet data into the 
buffer memory section 57 temporarily and thereafter packs 
each of the inputted packet data items, mixes them on a GOP 
basis, and inputs the resulting data to the D-PRO section 36. 

The D-PRO section 36 puts together units of 16 packs into 
ECC groups and sends them labeled with ECC to the drive 
section 32. When the drive section 32 is not ready for 
recording, the D-PRO section 36 transfers them to the 
temporary storage section 34 and waits for the drive section 
32 to be ready for recording. When being ready for 
recording, the drive section 32 starts to record. To hold more 
than several minutes of recording data in high-speed 
accessing, the temporary storage section 34 is expected to be 
a large capacity memory. 

At the time of recording end, the information necessary 
after the recording end is recorded in the playback control 
information 102 in the control information 78 and the 
volume & file management area 70 and then the video- 
recording operation is ended. To read and write files from 
and into the volume & file management area 70, the micro- 
computer can read and write data from and into the D-PRO 
section 36 via a microcomputer bus. 

In data processing during playback, when the MPU sec- 
tion 30 receives a playback instruction as a result of the 
user's key input, it reads the volume & file management area 
70 via the D-PRO section 36 from the drive section 32 and 
decides the address to be reproduced. Here, the management 
area indicates a volume descriptor and a file management 
section. The volume descriptor is used to judge whether or 
not the disk is a DVD disk. The information in the file 
management section is used to take out the control infor- 
mation 78. On the basis of the control information 78, the 
video objects 82, 84, and 86 corresponding to the title to be 
reproduced are determined and the address at which play- 
back is to be started is decided. 

The MPU section 30 sends the address of the decided data 
to be reproduced and a read instruction to the drive section 
32. The drive section 32 reads the sector data from the disk 
10 according to the sent instruction, corrects errors in the 
data at the D-PRO section 36, and outputs the data in the 
form of packs to the decode section 60. 

In the decode section 60, the separator 62 receives the 
read pack data, puts together the data into packets, and 
transfers them according to the type of data in such a manner 
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that it transfers the video packet data (MPEG video data) to 
the video decode section 64, the audio packet data 68 to the 
audio decode section 68, and the sub-picture packet data to 
the SP decode section 65. The PTS of each of the sent packet 
data items is loaded into the STC section (the MPU section 5 
30 sets the PTS in the pack in the STC 38,. or the video 
decoder section 64 sets the PTS of the video data item in the 
STC section automatically). Thereafter, each decode section 
carries out the playback process in synchronization with the 
value of the PTS (presentation time stamp) in the packet data 10 
item (while comparing the value of the PTS with that of the 
STC), thereby reproducing moving pictures with titles on 
TV. 

Furthermore, the playback operation of the microcom- 
puter of the present invention will be explained according to 15 
the operation flow shown in FIGS. 16 and 17. A normal 
playback operation will start, when the PLAY key is pressed. 
At this time, if the title number has not been specified 
beforehand, the playback of a file with title 1 corresponding 
to the default, that is, a video object (VOBU), is assumed to 20 
be started. 

When step S10 in FIG. 16 is started, the control infor- 
mation 78 is read first as shown in step 12. Specifically, the 
PGC information 116 of FIG. 8 in the control information 78 
is read into the MPU 30. As shown in step 14, when the user 
specifies a title, or default title 2 is selected, each piece of 
information on the desired title is taken in from the search 
pointer in the PGC information table 110 and the beginning 
address of the video object is taken out. Namely, the PGC 
number to be reproduced and the cell number are deter- 
mined. As shown in step S16, each decoder is subjected to 
initial setting according to the contents written in the play- 
back management table of the control information. As 
shown in step 18, the cell to be reproduced is searched for 
according to the contents of the PGC 1 116 and the necessary 
pre-processing command is executed. The pre-processing 
command is written in a command table provided in the 
PGC information table 110, as the need arises. Thereafter, 
the cell is reproduced as shown in step S20. As shown in step 
S22, when the cell reproduced is not the last cell, the next 
cell number is counted up as shown in step.S24, and control 
is passed to step S20. 

At step S22, the playback end of the cell is waited for. 
After the cell has played back, control is kept still for the still 45 
time of the cell as shown in step S26. When the still time is 
0, control is passed without doing anything to the next step 
S28. Thereafter, a post-processing command is executed at 
step S28. Like the pre-processing command, the post- 
processing command is written in a command table provided 5Q 
in the PGC information table 110, as the need arises, and is 
taken out, as the occasion demands. 

When at step S30, the playback does not end and there is 
a PGC to be reproduced next, the next PGC number is 
determined and control is passed to step S18. When the 55 
playback ends, a playback end process is executed at step 
S32. That is, each decoder is reset and the GPRM is reset. 

Next, the cell playback operation of the microcomputer 
shown in steps S20 and S22 of FIG. 16 will be explained 
according to the operation flow of FIG. 17. When the 60 
process in reproducing a cell shown in step S40 is started, a 
check is made to see if VOBUs are consecutive as shown in 
step S42. If they are consecutive, control is passed to step 
S48. In step S42, when the cells are not consecutive, the 
PGC information 116 is referred to at step 44, the playback 65 
start address is determined, and the data read command, 
together with the playback start address, is set in the drive 



40 



section 32. The control information 78, that is, the cell 
playback start time (C_PBTM) in the cell playback infor- 
mation 120 is taken in by the MPU 30 and stored in the 
RAM. The cell playback start time (C_PBTM) is displayed 
on the display unit and the playback of the cell is resumed 
on the basis of the playback time. As shown in step S50, 
when the stop key is pressed in the course of reproducing the 
cell, control is passed to step 60, where a playback interrupt 
operation is started. That is, the necessary playback interrupt 
information is written in a playback interrupt information 
table prepared as a single file shown in FIG. 9. Thereafter, 
the cell playback ends on the basis of the a playback stop 
instruction as shown in step S62. 

When at step S50, the stop key is not pressed in the course 
of reproducing the cell, a check is made at step 52 to see if 
the cell corresponds to the last cell. If the cell is not the last 
cell, control is returned to step S50. If the cell is the last cell, 
the playback of the last VOBU in the cell is waited for as 
shown in step S54. When the playback of the last VOBU has 
ended, control is kept still for the still time of the cell and 
control is passed to the next step S58. When the still time is 
0, control is passed without doing anything to the next step 
S58. Because the cell is the last cell at step 58, control is 
passed to step S26 in FIG. 16. 

The process in a case where, for example, the DVD disk 
10 is removed after the cell playback is interrupted, and then 
the DVD disk 10 is loaded into the DVD recorder again to 
resume the playback will be explained by reference to FIG. 
18. 

After the DVD disk 10 has been loaded into the DVD 
recorder, when the playback is resumed by pressing the 
resume playback key as shown in step S70, the playback 
interrupt information table of FIG. 9 is first read from the 
disk as shown in step S72. On the basis of the playback 
interrupt information in the playback interrupt information 
table, the playback title during interruption, in other words, 
the video object is determined. On the basis of the 
information, the register in each section is set. The necessary 
information in the information is stored again into the RAM 
of the MPU 30. Thereafter, the control information 102 is 
read at step S76. Here, the PGC information 116 is stored in 
the RAM of the MPU 30. As shown in step S78, the PGC 
number to be reproduced, cell number, and VOBU number 
are determined on the basis of the playback interrupt infor- 
mation in the playback interrupt information table. As 
shown in step S80, the video decoder 64, sub-picture 
decoder 65, and audio decoder 68 are set similarly on the 
basis of the playback interrupt information. As shown in step 
S82, a check is made to see if the address at which the 
playback is to be resumed is the beginning of the cell. If it 
is the beginning of the cell, the pre-processing command is 
executed as in the normal playback process at step 18. 
Thereafter, control is passed to step S90, where the normal 
playback process shown in FIG. 16 is executed. Specifically, 
the process in cell playback is executed as in step S20 of 
FIG. 16. If the address at which the playback is to be 
resumed is not the beginning of the cell, the PGC informa- 
tion 116 is read as shown in step S84 and the playback start 
address is determined. For example, the relative address of 
the VOBU is referred to and the relative address is added to 
the first VOBU address in the cell, thereby determining the 
playback start address. Once the playback start address has 
been determined, a read instruction is given to the drive 
section 32 using the address as shown in step S86. At step 
S90, the VOBU is interpreted as the first VOBU and the 
playback of the first VOBU is resumed as in the normal cell 
playback. Step S92 to step 104 after the resumption corre- 
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spond to the processes from step S22 to step S34, which 
executes processes similar to what has been explained 
above. Thus, for detailed explanation, refer to step S22 to 
step S34 shown in FIG. 16. 

Next, the process of displaying the playback remaining 
time using the playback interrupt information in the play- 
back interrupt information table shown in FIG. 9 will be 
explained by reference to FIG. 19. The playback remaining 
time corresponds to the remaining time of the program in a 
case where a certain program is recorded on a disk or more 
than one program is recorded on a disk and the user 
interrupts the playback in the course of playing back the 
program, leaving part of the program unwatched, or to the 
playback time of the program in a case where there are some 
the user has not watched in the programs recorded on the 
disk. The programs recorded on the DVD disk are important 
to the user. In addition, whether the user has watched the 
programs, and if not, how long the remaining time is are also 
important to the user. In a case where the remaining time can 
be known disk by disk, if busy users of today can know 
easily whether they can watch the programs in free time, this 
will help provide the user a comfortable environment. 

Id the processing of FIG. 19, explanation will be given, 
provided that a cell corresponds to a program and a PGC 
corresponds to a recorded title. First, a DVD disk unknown 
as to whether it has been watched is loaded into the disk 
changer section 110, thereby making preparations for play- 
back. Thereafter, as shown in step S110 of FIG. 19, when the 
remaining time key is pressed via the key input section (not 
shown), the process of displaying the playback remaining 
time is started. After the process is started as shown in step 
111, the playback interrupt information shown in FIG. 9 is 
read and the cell ID whose playback has been interrupted is 
checked. Referring to the cell ID, the cell playback infor- 
mation of FIG. 13 corresponding to the cell is read. The 
playback time of the cell is taken out from the cell playback 
information and the elapsed time in the cell indicating the 
time during which playback has performed in the cell is take 
out from the playback interrupt information. The cell 
remaining time is calculating from both of those, or by 
subtracting the elapsed time in the cell from the cell play- 
back time. Similarly, as shown in step S113, the PGC 
number of the interrupted PGC is checked from the playback 
interrupt information. The PGC general information of FIG. 
12 corresponding to the PGC number is read and the PGC 
playback time is taken out. At the same time, the elapsed 
time, the total value of the playback time of the already 
reproduced cell constituting the PGC, is calculated using the 
cell playback information. The playback remaining time in 
the PGC is calculated from both of those, or by subtracting 
the elapsed time until the interruption of the playback from 
the PGC playback time. Thereafter, as shown in step S114, 
the program remaining time is displayed as the playback 
remaining time of the cell and the video-recording remain- 
ing time is displayed as the PGC remaining time. After the 
display has been acknowledged by the user, the process of 
displaying the playback remaining time is ended as shown in 
step S115, and control is returned to the playback preparing 
state. 

In the above embodiment, a format structure as shown in 
FIG. 3 proposed as A new recording and reproducing 
standard has been explained. In additional explanation, there 
is the following structure according to a DVD video ROM 
complying with the already determined recording and repro- 
ducing standard. This structure will be explained by refer- 
ence to FIGS. 20 and 21. 

An RTR (Real Time Recorder) video manager 200 
(RTR_VMG) shown in FIG. 20 corresponds to the control 
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information shown in FIG. 3A. Following the RTR video 
manager, a video object set 80 is arranged. Its structure is the 
same, so its explanation will not be given. 

The RTR video manager 200 (RTR_VMG) includes RTR 
video manager information 201 (RTR_VMGI) and other 
tables (1) 202. The RTR video manager information 201 
(RTR__VMGI) includes a video manager information man- 
agement table 203 (VMGI__MAT) for managing the RTR 
video manager information 201 (RTR_VMGI) and other 
tables (2). In the video manager information management 
table 203 (VMGI_MAT), a VMG identifier, management 
information including the end addresses of RTR„VMG and 
VMGI, and resume marker information (RSM_MARKJ) 
acting as the playback interrupt information are written. As 
shown in FIG. 21, in the resume marker information (RSM_ 
MARKI), the PGC number (PGCN) at which the marker 
point indicating the interrupt point is present, program 
number (PGN), and cell number (CN) are written as inter- 
rupt information, as in the table of FIG. 9. Furthermore, the 
relative time in the marker point cell, in other words, the 
elapsed time until interruption in the VBOU to which the 
cell belongs is written as PTM (Presentation Time Stamp) 
using a marker point (MRK_PT)< Because most cells are 
generally recorded in such a manner that they coincide with 
VOBS, the time expressed by the marker point (MRK__PT) 
is such that the elapsed time until interruption in the cell is 
expressed in PTM (Presentation Time Stamp) form. The 
time when a marker point (MRK_PT) is attached is written 
as a marked time (MRK__TM). 

In the other tables (1) and (2) 202 and 204 in FIG. 20, 
various types of information, including the playback control 
information 102, recording control information 104, editing 
control information 106, and reduced drawing information 
108, are written at the same level or different levels of 
hierarchy. 

In the resume marker information (RSM MARKI) 

shown in FIG. 21, the address of the VOBU to be repro- 
duced first after the interruption of playback is not written. 
It is, however, marked easily by preparing a time map 
describing the relationship between the elapsed time in the 
cell marked with the marker specified by a cell number and 
the address of the VOBU in the other tables (1). That is, the 
VOBU to be reproduced after interruption can be deter- 
mined. Namely, in the other tables (1), an information table 
about moving -picture files is provided. In the table, files 
about moving-picture VOB information is provided. The 
files about moving-picture VOB information include time 
map information in which information on the VOBUs in the 
files is written in time map form. In the time map 
information, the playback start time and size of each VOBU 
are written. Therefore, referring to the marker point (MRK__ 
PT) in the resume marker information (RSM_MARKI), the 
VOBU is determined from the time during the interruption 
of the playback. The address of the determined VOBU can 
be calculated by calculating the sum of the sizes of the 
VOBUs in the VOB reproduced before the determined 
VOBU. The VOBU determined by the calculated address is 
the VOBU to be reproduced first after the interruption of the 
playback. 

Because in the format of FIG. 20, the resume marker 
information (RSM_MARKI) is written as VMGI_MAT 
204 at a relatively higher level of hierarchy, the player can 
use the information immediately. Such a structure is, 
therefore, a user- friendly structure. 

Industrial Applicability 
As explained above, with the present invention, because 
the playback interrupt information has been written on a disk 
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serving as a video-recording and reproducing information control means for holding the control information read 

recording medium, even if the disk is removed from the from the management area, and controlling repro- 

system, the playback can be resumed after the disk is ducing means based on the control information; 

installed again. decoding means for decoding and reproducing the data 

What is claimed is: 5 read from the data area; and 

1. An information recording medium for recording and reproduction interruption information processing 
reproducing information, comprising: means for generating reproduction interruption 

a data area for storing a video object unit which comprises information, and writing the reproduction interrup- 

a video pack storing video data or an audio pack storing ti 0 n information in the recording area, when a repro- 

audio data, the video data or the audio data to be 1Q duction interruption operation is performed while the 

reproduced in a predetermined time period, the data reproduction means is performing reproduction, 

area allowing the video object unit to be reproduced 3 An i n f orma uon recording and reproducing apparatus 

from the data area, the video pack or the audio pack according to claim 2 , wherein the reproduction interruption 

including a packet header including presentation time p rocessing means records a specified point of 

stamps, i5 ^ S p ec if] e d cell in the reproduction interruption informa- 

a management area mcluding a plurality of information tion recordl area as the time in f orrrj ation. 

blocks for managing the data recorded in the data area, 4 ^ information rtcor6kl and reproducing apparatus 

the management area including a recording area for ^ whereinlhe reproduction interruption 

storing information of a cell which refers to a presen- . c ? ? r. ♦ 

tation period of the data and program chain information ^formation processing means records a presentation time 

which manages a sequence of cells including the cell; 20 related to a specified video object unit in the reproduction 

anc j interruption information recording area as the time lnforma- 

a beginning information block located in the management Uon * . „ . , . 

area and including a reproduction interruption infor- 5 - ™ e information recording and reproducing apparatus 

mation recording area for storing information for use in according to claim 2, wherein the reproduction interruption 

determining a position which is subsequent to a data 25 information processing means records a program number 

area at which a reproducing operation is interrupted, indicated by the program chain information in the reproduc- 

and from which the reproducing operation is to be tion interruption information recording area, 

resumed, the reproduction interruption information 6. An information recording and reproducing method for 

recording area including areas for respectively storing a recording/reproducing disk which is configured to include 

a specified program chain number, information related 30 (0 a data area for storing a video object unit which com- 

to a specified cell, and time information for indicating prises a video pack storing video data or an audio pack 

a specified point of the position in the data area, the storing audio data, the video data or the audio data to be 

reproduction interruption information recording area reproduced in a predetermined time period, the data area 

being located close to an information area for storing allowing the video object unit to be reproduced from the data 

information for a search pointer for a program chain. 35 area> thc video pack or me audio pack including a packet 

2. An information recording and reproducing apparatus headef foxing presentation time stamps, (ii) a manage- 
for a recording/reproducing disk which includes (i) a data ment ^ Chiding a p lurality of information blocks for 
area .for storing a video object unit composing a .video pack ^ ^ tccM m ^ ^ ^ e _ 
storing .video data or an audio , «dio data the * * ^ ^ fof informatioQ 
video data or the audio data to be reproduced in a prede- n u- u * • ~~~a J? *t,~ a**« «„a 
termined time period, the data area allowing the video object « of a call which refers to a presentation period of the data and 
unit to be reproduced from the data area, the video pack or P ro g ram cham information which manages a sequence of 
the audio pack including a packet header including presen- cells including the cell, and (in) a beginning information 
tation time stamps, (ii) a management area including a block located in the management area and including a 
plurality of information blocks each containing control reproduction interruption information recording area for 
informauon for managing the data recorded in the data area, 45 storing information for use in determining a position which 
the management area including a recording area for storing is subsequent to a data area at which a reproducing operation 
information of a cell which refers to a presentation period of is interrupted, and from which the reproducing operation is 
the data and program chain information which manages a to be resumed, the information for use in determining the 
sequence of cells including the cell, and (iii) a beginning position including reproduction interruption information, 
information block located in the management area, and 50 and including areas for respectively storing a specified 
including a reproduction interruption information recording program chain number, information related to a specified 
area for storing information for use in determining a position cell, and time information for indicating a specified point of 
which is subsequent to a data area at which a reproducing the position in the data area, the reproduction interruption 
operation is interrupted, and from which the reproduction information recording area being located close to an infor- 
operation is to be resumed, the reproduction interruption 55 mation area for storing information for search pointer for a 
information recording area including areas for respectively program chain, 

storing a specified program chain number, information the recording and reproducing method comprising the 

related to a specified cell, and time information for indicat- steps of: 

ing a specified point of the position in the data area, the reproducing the video object unit; and 

reproduction interruption information recording area being 60 recording the reproduction interruption information on 

located close to an information area for storing information the recording/reproducing disk, 

for a search pointer for a program chain, 7. An information reproducing method for a reproducing 

the information recording and reproducing apparatus disk which includes (i) a data area for storing a video object 

comprising: unit which comprises a video pack storing video data or an 

reading means for reading the data in the data area and 65 audio pack storing audio data, the video data or the audio 

the control information in the management area of data to be reproduced m a predetermined time period, the 

the recording/reproducing disk; data area allowing the video object unit to be reproduced 
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from the data area, the video pack or the audio pack 
including a packet header including presentation time 
stamps, (ii) a management area including a plurality of 
information blocks for managing the data recorded in the 
data area, the management area including a recording area 5 
for storing information of a cell which refers to a presenta- 
tion period of the data and program chain information which 
manages a sequence of cells including the cell, and (iii) a 
beginning information block in the management area includ- 
ing a reproduction interruption information recording area 10 
for storing information for use in determining a position 
which is subsequent to a data area at which a reproducing 
operation is interrupted, and from which the reproducing 
operation is to be resumed, 



,334 Bl 

24 

the reproduction interruption information recording area 
including areas for respectively storing a specified 
program chain number, information related to a speci- 
fied cell, and time information for indicating a specified 
point of the position in the data area, the reproduction 
interruption information recording area being located 
close to an information area for storing information for 
searching for a program chain, 
the reproducing method comprising the steps of: 

reading control information in at least a part of the 

management area of the reproducing disk; and 
reading data in at least a part of the data area. 

***** 
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